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FOREWORD 



JAMES L. DENNIS, M.D.* 
University of Oldahonaa Medical Center 



Distinguished guests and colleagues, welcome to Oklahoma, to Oklahoma 
City and to the University of Oklahoma Medical Center campus. 



Someone has described planning as the projection of a wedding between 
the ideal and the practical. This is not easily accomplished in our complex society, 
but one of the catalytic agents that can make such a wedding possible is computer 
science. Cvurent pressures upon medical education are twofold. From one Mae, 
there is the explosion of knowledge and from the other side, the pressures from 
society to fill the gaps in the health care system and to maintain the ongoioig 
quality of the physicians we graduate to prevent obsolescence. Computer science 
offers perhaps the most attractive possibility for bringing order out of chaos. 



When faced with the problem of relating medical education to societal needs, 
one must be very concerned about the protection of acadeinic excehence and 
its future enhancement. The pressures to become involved in the d^vcry ot 
mass health services to relieve the shortages and deficits that exist in the nation 
are tremendous. Many people now turn to the medical centers to solve their 
problems and we cannot ignore our responsibilities. The situaUon is similar o 
that of the chicken and the pig who were worried about their kind master ^o 
was having a very hard time. They wondered what the)^ TOuld do tohe ^. e 
chicken said, "We can feed him,’’ and the pig asked. Feed him what ? ™ 
chicken responded, “We can feed him ham and eggs to which the pig reacted 
immediately, “For you that’s only a commitment, but for irie that s total involve- 
ment.’’ Certainly, anytime a medical educational institutiori takes fh® 
sponsibility of an undefined mass health service program, this n^s total in- 
volvement and with the same results that the pig anticipated. Thraefore, we 
must have a protected core of academic excellence, as is found m the researcn 
and educational programs. Here is the fountainhead for new knowledge and ne(w 
developments. ’The development of a health center concept whose activities g^ 
programming closer to the public, provides communication from the researcn 
Ln?h and 3ie academic desk by way of programs that permit an immediate 
transmission of new knowledge and new technology to the pubuc. 



We thought that the health service problems on the one hand and the health 
science challenges on the other were more than a single m^ical 
state such as (Sdahoma could meet, without forming an alliance with (Jhers in 
our community who have responsibiUties for the healQi sciences. We went to out- 
standing citizens of this state and discussed the possibility of developing what 
we now call the Health Sciences Foundation. This foundation, was formed not 

•Vice Preaidint for Medical Center Affairs and Dean, School of Medicine 



to run the proposed Oklahoma Health Center hut to aid and assist institutions 
who were willing to huild in geographic proximity to the University as a core 
and to commit themselves to assisting the University in its mission of health man- 
power production and the pursuit of knowledge. The planning is well along 
and huildings are under construction. The Health Center will have interfaces with 
institutions at city, county, state, and Federal health agency levels and with 
both private and public agencies and institutions. Many central services and 
facilities will he snared hy all of these institutions. This means that funds for 
capital investments that we receive at the Medical Center can go into lahora- 
tories, classrooms and beds rather than into steam, refrigeration and laundries. 
The Oklahoma Health Center is coordinated by an operations committee com- 
prised of the heads of each of the institutions that will locate here. iTiis comnut- 
tee deteimines feasibility and recommends policy and procedures to our in- 
dividual governing boards. These are presented to the Foundation for implemen- 
tation. All of these activities are tied together by a rather ambitious computer 
program and, of course, the concept of reacliing out into the state is very much 
dependent upon computer technology and computer-based communication. 

This conference, to cjrolore the role of computers in medical education, is a 
very timely one because ot the current examination into curricula, programs and 
facilities for health ir anpower. Much should be learned from this opportunity for 
knowledgeable people to interact, and the discussion could have a significant 
impact on the future of medical education. 
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MEDICAL TECHNOLOGY AND SOCIAL CHANGE 

J. HERBERT HOLLOMON, PH.D.* 



Good morning, ladies and gentlemen. 
Welcome to the conference on computer 
and medical technology. 

I speak to you on a subject on which I 
am not an expert. So I would like to 
make the subject somewhat more gener- 
al at first. I wish to discuss the general 
relationship between technology and so- 
cial change. We face a time in history in 
which many people believe that technol- 
ogy and its consequences have become 
so hannful to the society that this harm 
overrides the possible good that technol- 
ogy brings. People — young people par- 
ticularly, perhaps more perceptive, more 
caring, more affluent dian any yoimg 
people of any society — have begun to 
ask questions: “How is it that you allow 
technology to pollute the atmosphere, 
when you build factories? How is it that 
the people who utilize technology allow 
the streams to be polluted so that our 
water supplies are undrinkable?” “How 
is it that a society can allow a system to 
operate that allows 50,000 people to be 
killed in highly technical devices caUed 
automobiles, and. 2 or 3 or 4 miUion, 
whatever the appropriate number, 
wounded?” “How can a society not con- 
sider deeply the problems that are creat- 
ed with the introduction- of agricultural 
technology which so improves the lot of 
the farmer and the efficiency of the ag- 
ricultural process that it displaces the 
marginal worker and forces him into die 
dty and leaves him there to sulk and to 
become discouraged and become dis- 
connected with the very society which 
that technology is supposed to serve?” 
“How can a society be so inhumane as 
to bring new medical technology to a 

*Fresident-Designate, 



country to decrease the birth rate, in- 
crease the life expectancy and decrease 
the death rate and allow those people to 
starve?” The young person continues to 
ask, ‘What is the value of a system that 
does not consider slow starvation as 
deadly and as devastating as a sudden 
death?” "What,” says the young fellow, 
“is the problem with a society that does 
not seem to be able to control the natoe 
of the weaponry that technology brings 
- whether that weaponry is nuclear 
bombs or chemical and biological war- 
fare?” That’s one side of the question. 

And the other side of the question is 
that the devices of technology, the engi- 
neering achievements of man over thou- 
sands of years, thousands of centuries in 
his evolution, have made it possible for 
man to survive at all. It seems almost 
abundantly clear that without weapons, 
man could not have survived and devel- 
oped in an evolutionary way the deep 
culture and the nature of the society. 
The weapon became a tool, and the tcwl 
made it possible to remove much of the 
burden, at least of the afflueiit society, 
from man’s back. It extended his arms; it 
plowed his fields; it helped in the treat- 
ment of disease. Technology has been 
the means by which it has become possi- 
ble for man to use his creative talents to 
do something more than be a slave to 
the driving necessity of having food and 
shelter and clothing and protection. 

Technology has two sides. It has on 
the one side the immediate and direct 
benefits that it brings in the treatment, 
the caring, the feeding, the housing, and 
the transportation of people. And it has 
another side, and that is its potential 



The University of Oklahoma, Norman, Oklahoma 
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harmful effects on the society in general. 
This dichotomy, this difference in view- 
point, causes the deepest possible divi- 
sion in those people who are of good 
heart as to what is the proper use of 
technology for the benefit of society, 
and who is to decide? It strikes me 
strange, that in engineering, in medi- 
cine, and science, the people who are 
concerned with the application of tech- 
nology to the useful pmsuits of man, are 
not at the same time deeply concerned 
with the ethical, moral, political and le- 
gal questions which that very technolo- 
gy produces in its introduction. Let me 
ask you a few questions: Who shall de- 
cide when and under what conditions 
artificial devices will be used to extend 
man's life? Shall we leave it to doctors, 
as presently trained, doctors who are 
highly capable and highly skilled techni- 
cal people, but who are largely not 
knowledgeable of the law, of me socie- 
ty, of religion, faith, values and ethics? 
Having had to spend so much time be- 
coming the doctor that he is, is it possi- 
ble for him to decide the deepest kind of 
value judgments alone, such as who 
shall benefit from the technology which 
is just around the comer? Is it proper, 
for example, for a decision to be made 
as to which of two patients gets an arti- 
ficial kidney because one of them hap- 
pens to have more life insurance than 
the other and therefore his family can 
be better cared for? I wonder. 

The technology which man has devel- 
oped has made it possible for the social 
change in every modem society. Tech- 
nology and its development led to the 
industrial revolution. Technology and its 
development led to the development of 
the modem city. Technology and its de- 
velopment made it possible for only 
of the people in the United States to 
feed all the rest of us. Technology made 
it possible to handle information in such 
large quantities that no man can possi- 



bly compete with it as far as the storage, 
retrieval and codification of that infor- 
mation. Technology will, in fact, in the 
future make it possible for man to 
change the genetic character of men 
themselves. The technology that created 
the dmgs so wonderful in the treatment 
of disease, is yet the very beginning of a 
technology which will so infuse educa- 
tion and medicine that we can speak of 
the present time, not as an industrial 
revolution, but as an information revolu- 
tion. We are at the stage in the society 
where the extension of man’s arm by 
machines and tools is now nearly com- 
plete, but the extension of man’s mind 
and perception in the seeing, evaluating, 
hanr&ng, storing, and projecting infor- 
mation has only begun. And if you think 
today’s sophisticated computers which 
are able to program themselves are so- 
phisticated, if you think that information 
censoring devices that can be used re- 
motely are sophisticated, I will remind 
you that they are yet but the very sim- 
ple and nascent beginning of what will 
be, for we have now discovered, like the 
discovery of steam pow'er and the me- 
chanics of converting heat to energy, 
that it is possible to manipulate, control 
and calculate the handling of informa- 
tion. And we have discovered simulta- 
neously that it is possible to do that on a 
very small scale, on a scale that does not 
yet reach the scale of the nemal net- 
works of the brain, but on a scale which 
in a decade may be so. We will be able 
as well to produce the kind of coimec- 
tions in a computer, that will make it 
possible for one to say truly that a ma- 
chine thinks, rather than just solves 
problems. 

All of these things raise the deepest 
lands of questions — questions, first, as 
to how these techniques are to be used 
and to what end, and how they shall af- 
fect the very people who use them, and 
what resistence the practitioners of 
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the old arts put up, for it is also true 
that technology, by being the mother of 
social change in many regards, is also 
resisted deeply and often effectively by 
the very people who have to put the 
technology to use. I was reminded one 
day of a conversation with President 
John Kennedy and one of his economics 
advisors. We were trying to persuade 
him and the President Aat everything 
that was being done except the final 
evaluation of the state of die economy 
by the economists could be done better 
by computer, and that we were not us- 
ing computers to model the economy, 
but rather we were using some sort of 
subjective ad hoc judgment. Ill never 
forget the day we tried to persuade 
them that technology would make wiser 
judgment possible % economists if they 
would but use it to model the economy. 
The Economist said to me, “Herb, but 
then what would I do?” And you know, 
that’s sort of an odd reaction — a reac- 
tion, however, that is completely under- 
standable, for all of us depend for our 
security on the things we’ve learned 
when young, and we depend for our 
jobs on the techniques and tools of a 
decade or two ago. 

Technology, specifically in medicine, 
will lead clearly to all sorts of artificial 
devices and implants. And here die 
question comes, just as in die case of 
drugs, under which conditions shall diey 
be used, what tests shall be required 
and what judgment shall be made? 
These questions will be applied, even 
more specifically to computers, and I 
don’t think the computer is nearly as im- 
portant as the whole process of handling 
information. It is the whole system. It is 



the conversion, the calculating, the scor- 
ing, the retrieving, the displaying, and 
the orderly logical sequence of the proc- 
ess. All too often, computers are used 
simply to replace manual operations. 
The computer provides, however, a 
technique and a possibility of doing 
things with information that man can’t 
do himself at all. And that’s why it is so 
important for us to consider how com- 
puters and information systems will in 
fact affect diagnostic and clinical aid, 
work on organizational or administrative 
problems, and most importantly, aid 
educational tools. But they will not work 
if they are a mere substitute for what 
humans are now doing, and they will not 
work unless the computer and the infor- 
mation system is deeply tied to the very 
people who have to use the information 
once it is produced. Information systems 
in medicine will make it possible to aid 
large numbers of people with relatively 
fewer profession^ly trained medical 
people. That doesn’t mean we won’t 
need more trained medical people, but 
the relative number should be smaller. 

One of the things that is so important 
in this country is that we have commit- 
ted ourselves to two deep responsibili- 
ties about people. One is, that Aey shall 
have the opportunity to have all tiie ed- 
ucation that tiieir ability and motivation 
allows them, independently of their 
wealth, sex, and color. This ideal is very 
costly. The second ideal is that no man 
should be without adequate medical 
services because of his position, his race, 
his color. If we are to do these two 
things at a price we can pay, our only 
hope is to use technology in its most 
beneficial way. 



OBJECTIVES OF CONFERENCE 

JOSEPH M. WHITE, M.D.* 



Mr. Chairman, Ladies, and Gentlemen: 

I wish to add my welcome to that of Dr. Dennis and Dr. Hollomon. I sm- 
cerely hope that you will enjoy your visit with us and that you will find me 
conference both interesting and stimulating. Our increasing capabiliUes to 
cover new uses for the modem computer plus the enormous efforts now being 
expended in almost all our medical schools in modification and revision or the 
medical curriculum make this conference a timely one. 

The use of computers as an educational tool is both direct and indirect. 
Indirect applications include the support of the administrative and research 
activities of a Medical School and, more recently, the processing of patient 
care information. Direct applications to medical education are now beginnmg to 
appear. These include information retrieval and the use of the computer ^ an 
instmctional tool. It is this latter role that we will be concerned with in detail 
during this conference. However, we must keep the other educational apphca- 
tions to mind and fully explore the potential for them. 

In any instructional system, three general problem areas must be considered. 
These have been described as the technical, semantic and effectiveness^ prob- 
lems. The technical problem is concerned with the hardware a^ equipment 
capabilities required to implement the system. The semantic problem has to do 
with the relationship between the meaning intended by the instructor and the 
interpretation made by the student. That is, design of a system which wiU ac- 
curate convey the instructor’s thou^ts to the student. Finally, the effectiveness 
of an imtructional system is concerned with those changes induced in the student 
by the instructional experience. Each of these should be carefuUy explored be- 
fore introduction of any new system. 

Before discussing &e specific objectives of this conference, it would be well 
to mention some of the thoughts of others regarding the role of computers to 
an educational setting. Three major roles have been defined: 

1. to serve as a resource to tlie student for study; 

2 to assist the instructor in his own study and preparation and in provision 
of timely summaries of student progress individually and as a group; and 

3 to provide assistance to the learning researcher. Some experience has been 
gatoed in each of these areas, especially to the undergraduate college 

curricula. 

The following general questions must be explored if the objectives of this 
conference are to be realized— 

1. What is now being done with computers in Medical Education? 

2. What are the realistic potentials of computers to Medical Education? 

3. What type of work must be done to realize that potential and how should 
this proceed? 

*Dean, Medical Faculty, University of Oldahoma Medical Center 
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These general objectives invoke a number of more specific considerations 

^^'mat are the technical problems that must be overcome? What constitutes 

an effective system? . , j 

Perhaps more importantly, what requirements are placed on the 
students to enable d^ to ™ke etfeotive use of the computer ^t^? 

How can programs be developed to petinil them to meet those require- 

zxi^sitsP 

Will students and physicians accept tlie direct use ^ 

their educational proceL? More specScally, will they utilize the 
computer by sitting at a terminal and interacting with an mstruchonal program 

How do we get them to take advantage of it? , i a j 

How can the total effectiveness of this means of instruction be evaluated 

and, obviously, it must! r.a . a 

How should such a computer based instructional system fit mto a modem 
curriculum? Should it serve primarily as a learning resource for Ae student or 
can it in fact be a basic part of his primary inshruction? Should such a system be 
independent or should itlie a part of a larger information system? 

Wough it is not possible at this time to provide the specific answ^ to ^ 
of th^e questions, we are hopeful that this conference can generate ideas and 

directions to follow if we are to find the answm. Wa nar 

The conference has been stmctured so diat each of you will be a^ to p»- 
ticdoatoa^vely in the discussion and as educators your ideas are n^ed. We 
tiiat the rZre or less informal nature of this conference will permit an envi- 
“ rSg to hill opportonity for 

ideas. If this coherence is to be a success it mean that all sides ot toe issue 
have been explored. We are hopeful that this will be done. 

Thank you very much. 



STATEMENT OF THE SURGEON GENERAL' 



WILLIAM H. STEWART, M.D. 






Medical education is challenged today as never before in its history. 
The needs and aspirations for medical care expressed by the Americ^ 
people demand rapid quantitative growth. Our professional commit- 
ment requires that this growth must not be accomplished at the ex- 
pense of quality. The explosive development of medical science and 
technology, by raising the potential for excellence ever higher, makes 
the production of such excellence increasingly complex and difficult. 

For these reasons it is vitally important that medical education draw 
upon the best in educational technology. We simply cannot meet the 
new challenge with the old familiar methods. Yet, at the same time, it 
is equally imperative that we be selective in adopting and adapting 
new methodology. We cannot afford to accept new methods just be- 
cause they are new, or abandon old ones because they are old. We 
need to measure such means against our fundamental purposes and 
choose accordingly. 

Therefore, this conference is not merely timely; it is of the highest 
urgency. In wishing you a most productive and successful meeting, I 
an? wishing more than that: that this conference may represent a 
simificant stride toward more productive and successful medical 
education in the years ahead. 



*TransmUted to Conference on the Use of Computers in Medical Educotion by Frank W. McKee, 
M.D., at opening plenary session. 
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EXCELLENCE - BUY OR BEGET? 

FRANK W. McKEE, M.D.* 



It is always a pleasure and privilege 
to participate in meetings dedicated to 
the study and improvement of medical 
education, and the exploration of better 
and more efficient ways of coping with 
this fundamental responsibility. I am 
particularly honored to be invited to 
speak before you begin your work in 
pursuit of the “Objectives of the Confer- 
ence” that have just been laid before 
you, because this offers me the opportu- 
nity to share with you some broader per- 
spectives of medical education into 
which these immediate objectives and 
your activities in support of them may 
fit. I should point out the rather obvious 
fact that my position on the -program 
should convey to you that I am not in. 
any sense an expert in the use of com- 
puters as an educational tool, or will I 
present any new experimental or other 
data about the subject of the confer- 
ence; otherwise I would be included 
with the quality cast you have assem- 
bled for that purpose. Therefore, I hap- 
pily accept my role as a layer of founda- 
tions, and will watch with interest the 
emerging structure of new contributions 
to the medical education process which 
you erect from niaii-made tools and sys- 

tems. . 

As many of you know, I am privileged 
to head the Division of Physician Man- 
power in the Bureau of Health Man- 
power. This Division is the focal point 
for medical education in the I^blic 



Health Service. Within the responsibili- 
ties of our assignment are those related 
to the major support of educational pro- 
grams, both in medical school cuiricula 
and in continuing education activities, in 
the construction of new schools for nil 
the health professions, additions and ren- 
ovations to existing schools, and in sup- 
port of hospital and patient care facili- 
ties which are intimately concerned with 
the educational process. The newly pro- 
grammed Basic and Special Improve- 
ment Grants, which are th(! Federal gov- 
ernment’s first clearly defined funds for 
;>upport of educational operations, are 
within our review mechanisms. Through 
research grants and contracts, support is 
offered for a variety of investigations of 
new approaches to educational format, 
with the piou.s hope of a dividend of ac- 
complishing some progress in the educa- 
tion of both medical students and prac- 
ticing physicians while the experiments 
go on. All of these efforts are compo- 
nents of the overall mission of the Bu- 
reau of Health Manpower which is di- 
rected towards a quantitative and quali- 
tative improvement in all the health 
professions in the provision of medical 
care for all the American people. In a 
nutshell, we are interested in increasing 
the number of qualified individuals who 
will responsibly take care of the sick, 
and act effectively in disease prevention 
and control, notivithstanding the other 
important considerations for develop- 



• Director, Dioision of Physician Manpower, Bureau of Health Manpower PHS, DHEW 




ment of new knowledge and the on- 
going study of disease processes. 

Having outlined, then, the specific ob- 
jective of increased numbers of qualified 
manpower, and having described the in- 
terests of my particular Division in the 
physician portion of this goal, and the 
various ways in which the production of 
physician manpower is supported, it is 
appropriate to offer some observations 
about the educative process itself and its 
dominant and pervasive role in the 
achievement of these national objec- 
tives. The follo\ving comments are not 
based on second hand or hearsay infor- 
mation, for, in dealing with all of the 
colleges of medicine and osteopathy, 
and having the privilege of assisting our 
national legislators and others in re- 
plying to a wide spectrum of inquiry 
and criticism of present medical care 
systems in the United States, one devel- 
ops a reasonably accurate, continuing, 
and rather acute familiarity with what a 
variety of our citizens think is wrong or 
lacking. In our ability and agility to re- 
spond to .such inquiries, a number of 
problems are further identified and pos- 
sible solutions are generated. 

The concerns of the public, as pre- 
sented in correspondence, and in other 
inquiry, fall into two categories. The 
first is that there are not enough physi- 
cians doing the right things in the right 
places. Rural areas, and inner cities 
seem to be tlie most easily identified des- 
erts of health care, but other geograph- 
ic areas and even our utopia of modem 
living, the suburb, has its problems. The 
fourth branch of.the Division of Physi- 
cian Manpower, to which I have not 
heretofore alluded. Physician Utilization 
and Supply, is concerned with solutions 
to tlie problems of physician distribu- 
tion, through encouragement of studies 
of more effective practice patterns, 
investigations of why major gaps in 
health personnel exist, and the means 



that might be best used to correct these 
unfortunate, and occasionally desperate, 
situations. 

The second major concern of the pub- 
lic relates to the inability of large num- 
bers of apparently eminently qualified 
young men and women to gain admis- 
sion to medical school. Letters on this 
subject are directed to a number of gov- 
ernment officials with pleas for interces- 
sion on behalf of this or that individual, 
a practice which is consistently regarded 
as meddling in the affairs of a school or 
schools. But, be that as it may, when 
there is public clamor, there will be ac- 
tion, and it is our hope that the expan- 
sion of established schools and the con- 
struction of new schools \vill provide 
increased educational opportunity for 
every qualified applicant in the United 
States. 

These two citations are foci of public 
attention and represent a surfacing of 
deeper and more complicated concerns 
about medical education which are in 
the purview of all of us who are in- 
volved both in providing it and support- 
ing it. These latter problems are many, 
with a large overlay of human nature in 
them, which often, siuprisingly, is more 
serious than financial problems. Of late, 
a number of cliches to identify elements 
of these problems have crept into the 
language of medical educators, and 
while some of these are tiresome and 
irksome and subject to interpretation by 
the one using the term or phrase, they 
do bespeak both complacency and, par- 
adoxicdly, a certain insecurity and 
“whistling in the dark to keep up cour- 
age” sort of attitude. Since I hardly have 
time today to run through a glossary of 
terms used by medical and other educa- 
tors to describe the ideals, the goals, the 
problems, and the underlying financial 
needs, yea, even demands, for their 
achievement or .solution, I will mention 
only one - “EXCELLENCE.” 
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Excellence is about as complete a 
^ord to define educational aims as one 
could wish, and has as synonyms — su- 
periority, preeminence, worth, value, 
goodness, purity, and greatness. Its es- 
sential meaning is merit and virtue, and 
could well join with motherhood, peace, 
the American flag, and the reduction of 
taxes as a standard under which we 
could all join. Excellence appears with 
an element of glibness in medical school 
publications, particularly those directed 
towards alumni and granting agencies, 
and I quote one such: 

“In the face of pressures for change, it 
is especially important that we keep our 
primary goals and responsibilities clear- 
ly before us. 

“The first of these is excellence in ed- 
ucation. This arises from the capabilities 
of the staff, the quality of the s^dent 
body, and the continuous upgrading of 
our educational program. It arises, too, 
from the commitment of the staff to re- 
cognizing the individual qualities of 
each student and building upon them. 
Although we will not invariably be suc- 
cessful, we strive for an environment in 
which understanding and enjoyment of 
education are shared by students and 
staff alike. As pressures rise for the edu- 
cation of more physicians, we must ex- 
amine our educational goals, explore in- 
novations, and establish our programs 
on the basis of the best evidence avail- 
able.” 

This is what I would call a complete 
statement, and while an expression of 
but one school, it could well serve all, 
and be a preamble to whatever might 
follow as definitions of accomplishment 
or requests from any and every source 
for support for faculty, students, and fa- 
cilities. It is hard to fault as an expres- 
sion of goals and implies all of the defi- 
nitions and synonyms of excellence in its 
stated quest. But while it can escape 
criticism as an ideal, it most certainly, to 



those who know about processes of im- 
plementation, lays itself bare to searching 
question, and the “feet of clay” on the 
quicksand of its major premise. In pur- 
suit of excellence, medical education has 
assumed a flavor of Madison Avenue 
and the supermarket, with “capabilities 
of the faculty” prominently mentioned 
as a pillar in generating “excellence in 
education.” 

Perhaps these “capabilities” should be 
scrutinized more closely to determine 
what they are, what they should be, and 
whether they are actually directed at 
the purposes of medical education and 
its ultimate goal of helping solve the 
problems of a real world of people, dis- 
ease, and untimely death. 

Some years ago, before the enormoas 
investment of tilie Federal Government 
in support of medical research, medical 
schools followed integrated programs 
embodying teaching, research, and pa- 
tient care with minimum categorization, 
because of the recognition of the impor- 
tance of all these elements in physician 
education. In recent times, however, this 
categorization has been carefully identi- 
fied, the components have been legisla- 
tively isolated, and the integrity of the 
school as a common center for medical 
education has been greatly changed. 
This situation has led, in hum, to con- 
siderable change in the faculty, those 
who constitute it, and what the ideas of 
both the school and the faculty member 
are about correlated responsibility. Re- 
cruitment of faculty is now a highly 
competitive exercise for trained individ- 
uals in short supply and is characterized 
by high interest am investigation of al- 
most everything about the candidate 
that has to do with prestige, funds, and 
personal contribution, in varying mean- 
ings of the term. Strange and unwar- 
ranted assumptions about teaching qual- 
ifications, character as a man, and as a 
model for students, are often made, and 
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may be covered by a statement such as, 
“He's a nice guy, and the students seem 
to like him.’’ The candidate himself is 
usually more captivated by the personal 
advantage of tlie situation, and concerns 
himself with his space, his arena of con- 
trol, be it medical specialty or research, 
his teaching “load,’’ not “opportunity,’ 
and what colleagues he will find worthy 
to help continue the rise of his star. 
From this sort of activity, then, comes 
one aspect of faculty capability, which 
is hardly conducive to a program of 
medical education directing young men 
and women to preparation for assuming 
major responsibilities in the care of sick 
people. 

A second factor in faculty capability 
is the actual involvement of patient care. 
At one time, all medical schools had 
numbers of competent full-time serious 
clinicians, who not only taught medi- 
cine, but personally practiced it. They 
were backed up by a substantial part- 
time or volunteer faculty who were ac- 
tually engaged in private medical prac- 
tice, and brought to the students and 
house officers a true flavor of day-to- 
day practice to complement other lessons 
of greater breadth or depth. With the 
growing ability, and incidentally, real 
need to attract funds through the mech- 
anism of research and its considerable 
support, more and more full-time faculty 
were added to the medical schools. Con- 
comitantly, burdens of increasingly de- 
manding practice greatly diminished the 
time available to the private practitioner 
to participate in regular teaching sched- 
ules. But whatever the factors responsi- 
ble, this chav>ge in personnel has done a 
grave disservice to many students who 
have a conscientious desire to become 
accomplished practitioners outside a 
university or medical school setting, and 
has effected a considerable diminution 
in “capability of the faculty’’ in its 
broader sense. Some expanded use of af- 



filiated hospitals has compensated to a 
degree for this change, and perhaps ex- 
plains the popularity of these programs, 
a popularity that often mystifies the 
full-time faculty member in his universi- 
ty hospital office. 

A third factor in determining “capa- 
bility of the faculty” is whether there is 
any general understanding of tlie rea- 
sons for the existence of a particular 
medical school, and what its major inter- 
nal role might be, as well as its responsi- 
bility in the local, state, or national com- 
plex. Such understanding should involve 
the President and the Board of Trustees 
as well as the Dean and the faculty. In 
some instances, where a single school 
exists in a given state, this responsibility 
should be quite clear, but I have been 
amazed in a recent visit to one such 
state to find the wide differences of 
opinion of the state legislators and the 
medical school administration as to the 
fundamental purposes of the medical 
school. However, if the true goals of the 
school are defined, and generally agreed 
upon, and if there is the intention to 
produce qualified graduates, who will 
contribute to the real world of dealing 
with illness and its prevention and con- 
trol, and who will be educated to devel- 
op high standards of responsibility and 
human concern, then the “capability of 
the faculty” is more easily attested, and 
the achievement of excellence is a real 
possibility. How strange it seems, in this 
day of heart transplants, Nobel and oth- 
er prestige prizes, and enormous indi- 
vidual project grants, that excellence 
can be pursued as a goal within itself. It 
actually can be more closely approxi- 
mated by accepting a clear and obvious 
responsibility, meeting it, and finding 
satisfaction in a job well done. 

Excellence, true excellence, was once 
developed and nurtured as a home- 
grown product and expressed itself in a 
dedication and loyalty to the institution 
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and understanding of its purposes which 
was truly representative of “capability 
of the faculty.” The teamwork was the 
result of years of associations with es- 
tablished trust and mutual interest. The 
final product - graduated physicians - 
reflected a stability, responsibility, and 
concern which was true excellence. The 
World Series will always be a better dis- 
play of baseball than .the All-Star games, 
and the school that begets its own excel- 
lence will always have more to offer its 
students and the people for whom it is 
responsible, than purchased "excel- 
lence.” 

From this inherent capability, then, 
comes the greater wisdom for designing 
a dynamic, competent, and inspiring ed- 
ucation program, which might reallij be 
accepted by the faculty responsible for 
it. The “quality of the student body” 
cannot fail to be enhanced, with per- 
haps some resolution of problems of ad- 
mission and the alarming attrition of ad- 
mitted students, and some true student 
enthusiasm for “the continuous (ly) up- 
graded educational program.” Concern 
for direct patient care, coupled with 
good educational techniques, will ainel- 
iorate public anxiety about physician 
supply and availability. Such concern 
will also have a salutary effect on the 
wasteful and distressing problem of in- 
creasing student attrition. 

A profession as essentially human as 
medicine must have a fum base in the 
character of its primary seat of produc- 
tion — the medical school, for it is from 
this focus that the true quality of profes- 
sional excellence emanates. 

Oh behalf of this ideal, it is the policy 
of tltis Bureau and Division to support 
institutions and strengthen them 
through their chosen administrative 



channels, so that the determination of 
the essential educational need is neither 
dissipated nor eroded by less important 
considerations. It is equally important 
for the Association of American Medical 
Colleges, acting through its individual 
constituents, to review the whole spec- 
trum of faculty acquisition and to en- 
courage principles and procedures more 
consonant with the needs and purposes 
of the system. 

The role of this conference is to dis- 
cuss among knowledgeable people an 
exciting adjunct to the processes of med- 
ical education, which can offer real as- 
sistance in solving problems of increas- 
ing information and demands for accel- 
erated production. I look forward to 
some interesting revelations and accom- 
plishments, but the keystone of this key- 
note address is that the success or fail- 
ure of our system of medical education, 
in its multitude of individually tailored 
and variously directed programs, de- 
pends on the character and the quality 
of its leaders and proponents. - The re- 
finement of procedure, the innovation of 
method, the desire for excellence as ex- 
pressed through graduates dedicated to 
medical care in all its facets, will always 
rely for their success upon the human 
beings who choose to accept responsibil- 
ity for the achievement of the goals of 
the profession, not the particular whim 
of a certain school or individual. The 
goals of the profession were defined 
long ago by Hippocrates, Jesus of Naza- 
reth, Maimonides, and have been e^- 
nestly supported through the ages ^ by 
considerable numbers of men of 
tion and principle. Perhaps we should 
all devote more attention to this funda- 
mental . matter, and I would urge your 
personal consideration. 
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EVALUATION OF THE USE OF COMF1 
MEDICAL EDUCATION 

STEPHEN ABRAHAMSON, PhD.* 



The use of emerging computer tech- 
nology in education is, of comse, quite 
recent. And, as is the case of the appli- 
cation of educational innovation to med- 
ical education, the introduction of com- 
puters as an aid to medical education 
comes significantly later. Thus, when 
one asks questions concerning evalua- 
tion of the use of computers, answers 
cannot really be found in data at this 
time. At least, data in substantial and/or 
significant amounts do not exist. Thus, 
this paper cannot assume the familiar 
form of a review of research or of a syn- 
thesis of published (or unpublished) re- 
ports. Rather, at this stage of develop- 
ment of the application of computer 
technology to medical education, one 
can only look forward to the design of 
studies and collection of data. 

Consequently, exercising familiar li- 
cense, the author is changing the topic. 
The modification truly reflects the 
chronological sequence of events in edu- 
cational innovation, incidentally, and at- 
tempts to warn — through some discus- 
sion — of the days ahead. Wliat factors 
must be considered as evaluation is 
planned and experiments are conducted? 
What data are needed to help us make 
informed judgments? What kind of re- 
search design will provide an adequate 
test of the use of computers in medical 
education? 

Despite the fact that millions of words 
of glittering prose ( and possibly some of 
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of evaluation, some re 
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dictum. But it is nor 
nonetheless important 

— unfortunately — di 
seems that because 
about objectives” for 
have somehow — thro 

— rid ourselves of the 
jectives, Such. is far fi 
gard to any educatio: 
ercise the questions n 
answered): What si 



* Director, Dioision of Research in Medical Education, School of Medicitte, 
em Califomia, Los Angeles, Cdifomia 



know at the end of this educational ex- 
perience? What should they know how 
to do? How else should they be 
changed? 

(2) Evaluation still demands criteria 
by which to -judge students’ achieve- 
ments of those objectives. While these 
are sometimes embodied in a good state- 
ment of objectives, more frequently they 
are omitted. How much new informa- 
tion should students have acquired? 
How proficient should they have be- 
come in the execution of specific skills? 
These questions should be answered, in- 
cidentally, before the attempt to meas- 
ure achievement and not afterward by 
scrutinizing scores of other records and 
assigning some “logical” (statistical or 
otherwise) cutoff point or points. 

(3) Evaluation still requires measure- 
ment of the achievement of each of the 
objectives. And educational measure- 
ment is best accomplished uni-dimen- 
sionally. That is, acquisition of informa- 
tion is most appropriately and reliably 
measured by application of some 
achievement-test technique — pencil- 
and-paper, perhaps. The measurement of 
achievement of skills necessitates some 
observation of the students in perform- 
ance of those skills - either directly or 
through the aid of electronics in the 
form of video-tape. But measurement, in 
whatever form, provides the information 
concerning student progress needed for 
the fourth step. 

(4) Evaluation still includes imple- 
mentation in the form of action involv- 
ing the student, the program, the objec- 
tives — or even the profession. One must 
study the results of measurement in the 
light of stated objectives, and according 
to the criteria make decisions — and take 
action. Here is the judgmental phase of 
evaluation. But it should not stop short 
of the accompanying action to revise the 
program, review the objectives, certify 
the students, or initiate new studies of 



students, program, or profession. 

Concerns in evaluation of the use of 
computers in medical education are per- 
haps best expressed in these four ques- 
tions. 

1. Does the use of computers facilitate 

learning? 

2. If so, does it do so at the expense of 

other objectives? 

3. What is the cost of the use of com- 

puters to facilitate learning? 

4. Does the use of computers result in 

less faculty and/or student input of 

time and/or effort? 

Essentially three areas of study are in- 
volved: (1) effectiveness, (2) cost, and 
(3) efficiency. The first two questions 
above deal with effectiveness, while the 
third and fourth refer to cost and effi- 
ciency, respectively. All of these become 
major concerns in any educational ven- 
ture — but particularly in the situation 
involving the introduction of innovation. 
There is no quarrel with the contention 
that conventional and standard and tra- 
ditional methods in education should be 
studied critically. For all too long edu- 
cation has enjoyed the luxury of as- 
sumption of achievement rather than 
having to test its processes critically. It 
has been said that physicians have such 
an enviable record of achievement in 
application of their professional per- 
formance perhaps because half their pa- 
tients would get better anyway. It is un- 
doubtedly true also, in that vein, that 
teachers (and traditional education) 
can boast of having achieved instruc- 
tional goals because students would 
learn anywayll Thus, all education 
should be, subject to careful study. But 
the real burden is upon the innovator, as 
we all know. The introduction of change 
in teaching methods must be accompa- 
nied by careful study. Especially as we 
operate in areas involving increased 
costs -or potentially increased costs — is 
it incumbent upon us to document our 
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success, or lack thereof. There is one 
comforting thought, incidentally. The 
more we attempt to study impact of ed- 
ucational innovation, the more we man- 
age to learn about conventional educa- 
tional processes. The more we apply 
ourselves to tasks of educational mea- 
surement with regard to studying out- 
comes of newer methods, the more re- 
fined our measurement techniques be- 
come — and these can then be applied 
in any educational milieu. The message 
really is to avoid any sense of paranoia, 
to avoid a posture of “why me?” when 
asked to justify — in educational out- 
come terms — the use of computers in 
medical education. 

Effectiveness — Does the use of com- 
puters facilitate learning? If so, does it 
do so at the expense of achievement of 
other educational objectives? The study 
of effectiveness cannot even begin, let 
alone proceed, without a clear statement 
of objectives. One cannot determine 
whether learning has been facilitated 
without the answer to a prior question: 
learning of what? At the same time, one 
must keep in mind that there are usually 
many objectives being sought — al- 
though perhaps not all in that specific 
application of instructional media. Nev- 
ertheless, they must be considered. For 
instance, if a technique is employed to 
facilitate the acquisition of information, 
it is important to know, of course, 
whether it did so. It is equally impor- 
tant, however, to discover whether the 
use of that technique also ( accidentally, 
inadvertently, incidentally) negatively 
influenced student attitudes toward 
learning, toward continued study, or 
even toward particular aspects of pa- 
tient care. It is possible for one learning 
experience to promote achievement of 
one set of objectives while significantly 
deterring achievement of another. Stud- 
ies of effectiveness should try to include 
some measurement of achievement of 



other objectives, hopefully representa- 
tive of all of the educational objectives 
of the total educational effort. In a 
sense, rival hypotheses must be stated 
and tested. 

In studying effectiveness, investiga- 
tors must also avoid the error of testing 
for educational gain only at the comple- 
tion of the instructional process. How 
long do students retain the new informa- 
tion? Over how long a period of time 
can students still perform the skills they 
learned? Data collected in other studies 
suggest rather strongly that retention 
may be related to certain other varia- 
bles: utility, motivation, experience. 

Studies of retention of information and 
skills gained through the use of comput- 
ers in medical education, thus, will help 
in the understanding of this aspect of 
education. 

Cost — It seems a shame to have to 
spend time on the question of cost. 
Here, again, is a question not really 
raised with regard to many other modes 
of instruction. Unfortunately, the bur- 
den of proof is on the innovator. And 
the initial cost of equipment plus the ex- 
pense of operation and maintenance are 
not insignificant. In addition, there is 
the area of preparation of “software” — 
tlie subject matter preparation, the pro- 
grams themselves. The cost in dollars 
and cents must be studied and included 
in evaluation. 

But that’s not all the cost that must be 
studied. In addition, the input of faculty 
time and effort in monitoring, in evalu- 
ating student progress, in just learning 
how tp prepare programs and use the 
computer hardware must be considered. 
Finally, revision and modification costs 
must also be calculated. Such costs in 
conventional education are minimal and 
frankly not considered. Where the tech- 
nology demands efforts beyond the nor- 
mal range, a systematic examination is 
in order. 
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Efficiency — Does the use of comput- 
ers affect faculty time and effort neces- 
sary to achieve the educational goals? 

By the same token, what is the effect on 
student input of time and effort? Epen- 
tially, a ratio of “output” to “input is in- 
volved and should be studied. The study 
of output must include such factors as 
number of students educated, how much 
they learned, how long they retain what 
they learned, how well they apply what 
they learned, how much they are stimu- 
lated to study more, and the like. The 
study of input includes such factors as 
how much time the instructors invested, 
how much time the students devoted to 
the learning process, how many faculty 
members were involved, how long it 
took the students to reach required per- 
formance levels, and the like. It is possi- 
ble that an “efficiency ratio” or an “effi- 
ciency index” must be developed and 
applied. Without it, statistical design 
must be employed to allow this area to 
be explored intelligently, for it is the 
area in which many claims have been 
made — and will continue to be made. 

Another interesting area of concern 
must be exposed and explored before 
this discussion moves on to suggested 
study design. This is the area of concern 
for patient safety and comfort. One per- 
sistent educational problem has always 
been how to have beginning students 
learn skills, the performance of which 
poses a threat to the safety and/or com- 
fort of the human object, the patient. At 
the University of Southern California, 
this concern led to the development of a 
computer - controlled anthropometric 
manikin — a patient simulator, which 
has come to be known as “Sim One.” 
The original purpose was to provide a 
simulated patient on which beginning 
anesthesiology residents might learn the 
skills of endotracheal intubation prior to 
their having to perform the intubation 
of real, live patients. At least, the moti- 



vation to begin this interesting work lay 
in this area of concern. The stated pur- 
pose of the project was to test the feasi- 
bility of simulating a living patient, ca- 
pable of responding in a lifelike manner 
to things done to it. In addition, effec- 
tiveness of its use in training anesthe- 
siology residents is being studied. 

Sim One is quite life-like in appear- 
ance, having a skin-colored, skin-tex- 
tured plastic covering in the form of a 
real human being. Sim One has the con- 
figuration of a live person from the 
waist up and is in the posture of lying 
on an operating table, Irft arm extended 
and ready for intravenous injection, 
right arm fitted with blood pressure 
cuff, and chest wall adorned with a 
stethoscope taped over the approximate 
locaHon of the heart. Sim One breathes; 
has a heart beat, temporal and carotid 
pulse, blood pressure; opens and closes 
his mouth; blinks his eyes; responds to 
four intravenously administered drugs 
and two gases administered by mask- 
and-bag or by tube. The important thing 
to note here is that Sim One has been 
used in the training of residents and ef- 
fectiveness tests reflect a great potential 
contribution to human safety and com- 
fort through having beginning students 
make their early errors and gain their 
proficiency and confidence on a com- 
puter-controlled “teaching aid” rather 
than on a real patient. 

The test of effectiveness involved five 
pairs of residents. These were assigned 
at random in such a way that five resi- 
dents were allowed to use Sim One and 
five were not. The measure of proficien- 
cy was a simple one. Hospital anesthesia 
records were examined by the anesthe- 
siology staff and a judgment was made 
about each: Would you trust this resi- 
dent alone in the operating room on the 
basis of performance like this? Needless 
to say, names and dates were concealed 
from the rater. One criterion selected 
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was the achievement of four consecutive 
“plus” ratings; that is, the rater would 
trust the resident in the operating room 
alone on the basis of what he reviewed 
in that chart. While the final analysis of 
data is not available at this moment, 
preliminary review indicates that it 
takes the non-simulator-trained residents 
twice the number of trials in the operat- 
ing room to reach that criterion level of 
performance when compared to the sim- 
ulator-trained residents. Such a differ- 
ence obviously represents a substantial 
difference in risk to patients!! 

It should be noted, incidentally, that 
Sim One represents a remarkably imagi- 
native application of computer technolo- 
gy to problems of medical education. 
Here is simulation at its most sophisti- 
cated; a realistic body with life-like re- 
sponses under computer logic. The dol- 
lar-cost of development has been high 
and the cost area in evaluation is indeed 
not on the positive side of the judgmen- 
tal ledger. Effectiveness and efficiency 
will be borne out by data but the combi- 
nation of cost and effectiveness might 
be found formidably negative in impli- 
cation. However, the human cost factor 
— patient safety — must also find its way 
into the total cost-effectiveness equa- 
tion. Thus, there are now four areas for 
study: effectiveness, cost, efficiency, 

and human safety. 

How should evaluation be conducted? 
The best single, simple answer is a for- 
mal, carefully controlled, experimental 
study. Not only will evaluative data be 
forthcoming, but comparisons with 
conventional educational methods will 
be possible. In this approach , one must 
attempt to control for all variables ex- 
cept one: the use of computer. Then 
with valid and reliable measurement of 
achievement level taken before and after 
the conduct of the educational experi- 
ence, the investigators can document 
whether the use of computers did in fact 



“facilitate learning.” And it must be 
pointed out that this kind of study is 
most likely to catch the attention of and 
convince the skeptics — if the use of 
computers does make a difference. Since 
the men who teach in medical schools 
are themselves scientists, they constantly 
seek data in support of ideas. Education 
is no exception for them in this regard. 
Furthermore, the areas of educational 
achievement studied should reflect the 
value structure of medical school faculty 
members. In other words, if achieve- 
ment in basic science areas is important, 
measurement of achievement in this 
area should be included — always re- 
membering, of course, that this is true 
only to the extent that such achievement 
is part of the objectives. 

Unfortunately, this approach is the 
most difficult to achieve in evaluation. 
Individual differences among students 
pose the first problem; faculty differ- 
ences, the second. No two schools are 
really alike enough to allow for one to 
be used as a “control” for another. Intro- 
ducing change of any kind also manages 
to change the total educational setting 
so that speculation can be raised con- 
cerning whether measured change in 
achievement is really only a reflection of 
the act of change itself: the so-called 
“halo” or “Mayo” effect. And, experi- 
ments within one school, conducted 
with time as the control variable, often 
stimulate other kinds of change within 
the school — even to the extent of draw- 
ing a different applicant-pool of stu- 
dents. 

As if these difficulties were not 
enough, another — less clear — problem 
needs mentioning. Each instructional 
mode may in fact have different goals 
which can best be served. Thus, to at- 
tempt a comparison in achievement 
when different teaching methods are 
used might start with a major bias if the 
achievement of the same educational 
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objectives is attempted using metho^ 
truly adaptable to quite divergent gods. 
But at this stage, such a consideration 
may be less important. It is presently in 
the best interest of medical education 
and of the use of computers that experi- 
mental design be accomplished wherev- 
er humanly possible. 

Where experimental design is not fea- 
sible, however, there is still the need for 
good, thorough evaluation.' Has the edu- 
cational experience really brought about 
the changes in students that were de- 
sired? (Were the objectives realized?) 
How much faculty time and effort were 
required? ( How much did it cost? ) 
Such an approach required “only” the 
definition of objectives, the statemrat of 
criteria, the selection or construction of 
measurement devices, the performance 
of measurement, and the interpretation 
of data collected. (Note the setting off 
of the word, “only”!!) If this process is 
achieved properly, the invesHVators will 
at least know whether objectives have 
been realized even if they cannot tell 
whether the process represents some- 
thing “better” than another approach. 

The role of the innovator is not an 
easy one. Not only is he the guy 
the “ideas.” Not only must he then find 



ways of accomplishing his ideas. Not 
only does he become the activist in in- 
troducing the innovation. Not only must 
he seek and obtain support for his idea. 
He must also test the idea and be pre- 
pared to defend - with data - in the 
face of all the difficulties in obtaining 
such data, his innovation. The role of 
the true innovator is a demanding one. 
He must be imaginative and flexible in 
order not to become ‘locked in” to one 
approach in the application of his genre 
of innovation. Computer use is a case- 
in-point. Storage and retrieval of infor- 
mation is but one of the many potenttal 
applications, yet for many this has be- 
come the end-all. He must promote the 
search for evaluative data - despite the 
fact that there are no such data avail- 
able concerning convention^ modes of 
teaching. He must serve as “public rela- 
tions” man for the entire area of innova- 
tion - not as high-pressure salesman, in- 
cidentally, but as thoughtful, data-laden 
investigator, raising questions and pro- 
viding data rather than exhorting, pro- 
moting, and promising Utopia through 
panacea. Here, then, is the essential con- 
Mbution of evaluation of the use of 
computers in medical education. 
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EDUCOM— A PROGRESS REPORT 
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E D U C O M, the Interuniversity 
Communications Council, is a proto- 
type endeavor, a research-oriented at- 
tempt to bring about educational in- 
novation. Let me begin by illustrat- 
ing, in a somewhat lighthearted and 
irrelevant fashion, the problems of in- 
novation and the need to move slowly 
and cautiously when initiating new 
programs. 

A pretest had been carried out on 
the effects of diet on the aging proc- 
ess. The experimental animals were 
porpoises. The porpoise is considered 
by many to be nearly as intelligent as 
man. They have large brains and are, 
in a sense, aquatic, humanoid basket- 
cases. The porpoises were given a 
number of different feeding regimes. 
A diet of newly hatched sea gulls was 
found to slow down, almost to halt, 
the aging process. It appeared that 
what amounted to immortality might 
be a possibility. 

The pretests were so striking that 
the research group received a large 
NIH program-project grant. Large, 
concrete porpoise pens were built on 
the seashore for containing the exper- 
imental animals. Up in the hills, an 
aviary for hatching sea gulls was 
built. A truck was dispatched daily to 
pick up the young fledglings and to 
take them down to the pens to feed to 
the porpoises. 

One day as the truck passed the 
City Zoo on its regular run, an old, 
distinguished, sedate lion suddenly 
and inexplicably bounded out of his 
cage and into the path of the truck. 
The truck could not help but run over 



him. The police soon arrived and ar- 
rested the truck driver for “transport- 
ing young gulls across staid lions for 
immortal porpoises.” If this irrelevant 
and irreverent fable does not illus- 
trate the dangers of innovation, noth- 
ing can. 

EDUCOM was founded about 
tliree years ago by a number of medi- 
cal deans and chancellors, specifically, 
those at Duke, Virginia, State Univer- 
sity of New York, Rochester, Pitts- 
burgh, Michigan, Illinois, and Cali- 
fornia. It was founded to facilitate 
and accelerate the use of the new in- 
formation processing technologies, 
where desirable, throughout the 
health sciences, educational, research 
and service activities of colleges and 
universities. 

It soon became apparent that ED- 
UCOM’s functions should not be re- 
stricted to the health fields but 
should be extended to all academic 
disciplines. While some of EDU- 
COM’s present members of the Board 
and officers are physicians, the major- 
ity are not. The organization has ex- 
panded rather rapidly although very 
little effort has been made to give it 
publicity. An article in Science ap- 
pearing in October, 1966, is the only 
published article describing the total 
EDUCOM program. There have, 
however, been a number of publica- 
tions relating to various specific proj- 
ects. 

At the moment, there am 89 univer- 
sities on our membership roll. They 
include about 250 campuses. EDU- 
COM is open to all colleges and uni- 
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versities of Canada, the United 
States, and Mexic» and will be 
pleased to accept your institution into 
membership if it is not a member. 

Several universities in England, 
France, Czechoslovakia, Sweden, 
Holland, and Australia have indicat- 
ed an interest in carrying out similar 
activities and in cooperating vwth 
American universities. We intend to 
consider potential international appli- 
cations as soon as some of our initial 
North American projects have given 
rise to services which will be of real 
help to participating institutions. In- 
ternational cooperation across oceans 
will be facilitated by educational sa- 
tellites which may be in orbit four or 
five years from now. 

Dr. Jordan Baruch has recently be- 
come our new President. A member 
of the MIT staff, he was formerly the 
head of the MEDINET program of 
General Electric. With the transfer of 
our national headquarters to Cam- 
bridge, Massadiusetts, we have de- 
veloped a redefinition of our func- 
tion. In the words of our new presi- 
dent, a major EDUCOM function is 
“to facilitate the extraorganizational 
communication of the universities.” 
The reason that the emphasis is on 
extraorganizational communication is 
because EDUCOM does not, except 
indirectly, intend to participate in ac- 
tivities which can be carried on as 
well by an individual professor or an 
individual university. We are interest- 
ed, rather, in helping institutions of 
higher education to share their re- 
sources and carry out joint programs 
which can be more efficiently han- 
dled, improve quality, and/or cut 
costs. We are concerned with rela- 
tionships not only among universities 
but between them and other parts of 
our society. We shall be concerned 
with such extraorganizational activi- 



ties as the regional medical programs, 
for example, which involve not only 
universities and medical schools, but 
also private hospitals and private 
practitioners. 

PANELS ON RESOURCE 
DEVELOPMENT 
EDUCOM is presently involved in 
reorganizing its technical and re- 
search programs, forming a new se- 
ries of national interuniversity panels. 

In the past we have operated through 
interuniversity task forces. The first 
task force was responsible for the 
programs in networking. The chair- 
man of diis task force has been Dr. 
George W. Brown, who was the 
founder of the Western Data Process- 
ing Center at UCLA and who has re- 
cently become Dean of the College of 
Administration at the University of 
California at Irvine. 

The original task forces were 
‘bootstrap” operations. Volunteer 
workers from the participant universi- 
ties gave their time, prepared pro- 
grams and proposals, and carried out 
research activities. EDUCOM has 
now attained some financial stability, 
however, having received several 
foundation grants, industrial grants, 
grants or contracts from the federal 
government, as well as institutional 
dues. It will soon be feasible for each 
of the panels to have full-time one or 
more professional staff workers, ei- 
ther in the central office in Cam- 
bridge or in the Bethesda office, 
where some of the government sup- 
ported research activities are now 
going on. 

The network task force will be 
reorganized into the panel on inter- 
connected computers, which will be 
concerned with the organizational 
and structural interconnection of 
computers, the hierarchical organiza- 
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tion of data within them, and human 
access to their capabilities. 

A second panel on resource devel- 
opment will be the panel on video 
and films, concerned with the use of 
video recordings, films, live produc- 
tion, closed circuit TV, and other 
such tools for augmenting the educa- 
tional process. 

Third, the panel on micrographic 
development i^l be concerned with 
the utilization of such techniques as 
photochromic reproduction in storing 
masses of document information, the 
interphase between such systems and 
the computer, and the use of such mi- 
crographic images. 

The Work of a Panel 

A new panel goes through a stage 
of group dynamics and a stage of 
self-definition of their mission. It may 
identify areas of appropriate activity 
for EDUCOM and it can suggest spe- 
cific projects for EDUCOM or some 
subset of its members. Such a panel 
will be different from a study section 
of the National Institutes ot Health, 
for example, in that its major role is 
to initiate programs rather than to re- 
spond passively to programs suggest- 
ed by individual professors or by uni- 
versities. But it certainly can receive 
such suggestions. In a few cases such 
suggestions have eventuated in pro- 
grams that . have been supported or 
sponsored by EDUCOM. 

EDUCOM panels can communi- 
cate among themselves to establish 
joint activities, since there will be in- 
tersections of interests among the 
panels. And they can maintain tempo- 
ral continuity. The life span of a 
group or organization may be far 
longer than any individual human life 
span. This means that continuity of 
programming is feasible even if indi- 
viduals rotate in and out of various 
panels. 



Panels in the Applications and Utili- 
zation Area 

The first of these is the panel on 
extended education, concerned with 
the continuing education of the 
professional, with the resumed educa- 
tion of those whose education has 
been interrupted, and with the reedu- 
cation of those dissatisfied with their 
careers. The panel on extended edu- 
cation is a reformulation of the task 
force on continuing education, 
chaired by Dr. George E. Miller, Di- 
rector of the Office of Research in 
Medical Education at the University 
of Illinois College of Medicine. 

The second panel in the applica- 
tions and utilization area is the panel 
on libraries and data banks. The pan- 
el is concerned with the utilization of 
stored information in the educational 
process, with the instructional impli- 
cations of the fact that large bodies of 
data can be made rapidly accessible, 
and with the development of the li- 
brary function broadly defined. The 
work in library communications was 
formerly in the EDUCOM task force 
on networks. It has become clear to 
us that, while there have been and 
will continue to be important over- 
laps between networking activity and 
library functions, they should be 
dealt with by separate panels because 
they are fundamentally independent 
fields. 

The third EDUCOM panel on ap- 
plications and utilization is the panel 
on external affairs, concerned with 
legislative matters, public policy, and 
social issues involved in educational 
information processing. Its predeces- 
sor was the EDUCOM task force on 
legal and related matters. It is co- 
chaired by Professor Benjamin Kap- 
lan of the Harvard Law School and 
Professor Arthur Miller of the Univer- ' 
sity of Michigan Law School. The 
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new panel will include attorneys, spe- 
cialists in libraries, television, and 
computers, and educators. EDUCOM 
has taken an active role in a n\imber 
of matters directly related to utiliza- 
tion of the new technologies in edu- 
cation, of whose importance many 
university faculties and administra- 
tions are unaware. For example. Con- 
gress is presently working on new 
copyright legislation, the first to ap- 
pear before Congress in about 60 
years. The draft of the bill passed by 
the House precluded the possibility 
of operating legally such an inter- 
university computer, library or televi- 
sion network as EDUCOM envisions. 
EDUCOM universities and officers 
sent statements or appeared at the 
Senate Committee hearings. These 
matters were also discussed with rep- 
resentatives of publishers and other 
industries. EDUCOM has had some 
role in slowing action on the copy- 
right legislation, which was written 
before tne importance and implica- 
tions of computers and networks be- 
came clear. The legislation can now 
be rewritten to permit adjustments 
for new technological developments 
as they occur. 

EDUCOM is also concerned with 
antitrust and negligence laws in the 
operation of interuniversity and in- 
trauniversity networks. A nonlegal 
but very important area concerns the 
ethical use of confidential informa- 
tion. This is particularly important to 
physicians in terms of patient records. 

EDUCOM’S Plans for Networks 

Althou^ EDUCOM is concerned 
with all applications of technologies 
in education, it has devoted particu- 
lar attention to the sharing of re- 
soiurces through the development of 
networks, planning to develop and 
operate a prototype interuniversity 



network. Net\vorks are nothing new. 
Natural networks have been in opera- 
tion as lo;:g as there have been col- 
leges and universities with one-way 
or two-way communication between 
two or more students and faculty 
members. A conference is one form of 
operation of a natural network. 

A different kind of network is a 
physical net\vork like the telephone 
network or the mails. A thorough 
analysis of communication among 
and within universities requires a 
comparative evaluation of traditional 
and new networks. Because a net- 
work employs a new technology ob- 
viously does not mean, of course, that 

it is better. , . 

At the same time that EDUCOM is 
involved in planning electronic net- 
works, it is also developing an organi- 
zational network. Each of our mem- 
ber universities has an institutional 
representative who communicates 
with his campus and represents his 
university with a vote on the EDU- 
COM Council. The Council elects the 
Board of Trustees and the Board of 
Trustees selects the permanent offi- 
cers and full-time staff. If we place a 
prototype network into operation, it 
must have its own organizational 

structiure as well. 

EDUNET 

The most intensive planning activi- 
ty related to networks in EDUCOM 
was accomplished at the University 
of Colorado at Boulder in July, 1966. 
The conference was funded by a 
grant from the National Library of 
Medicine, the National Institutes of 
Health, the National Science Founda- 
tion, and the Office of Education. 
About 185 people attended, repre- 
senting each of the 42 universities 
then members of EDUCOM, the ma- 
jor long line and hardware compa- 
nies, publishers, approximately 15 
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governinent agencies, and a number 
of foundations. The conference prod- 
uced a book called EDUNET, a re- 
port of the conference including opin- 
ions of the participants and a set of 
recommendations. 

The conference almost unanimous- 
ly agreed that there were real needs 
in colleges and universities for an in- 
teruniversity network. 

It was unanimously agreed that 
many different types of networks are 
technically feasible. An analysis was 
made of different possible configura- 
tions of networks, and their possible 
costs were estimated. The book also 
outlines an organizational structure 
which would be able to operate such 
a network. The last chapter is an in- 
formal proposal to a number of gov- 
ernment agencies who might contrib- 
ute to the funding of such a proto- 
type. 

The basic concept of EDUNET is ^ 
to encompass a number of activities 
already underway in a limited fash- 
ion. Some of these are limited geo- 
graphically, regional networks. EDU- 
NET is conceived as a national or 
conceivably, ultimately, an interna- 
tional network. Some networks are 
limited to a single medium, e. g., a 
nehvork for programmed instruction, 
a television network, or a network for 
teletype transmission of biblioCTaphi- 
cal information. EDUNET is devised 
on the assumption that all media 
must be employed, each when most 
appropriate educationally. From the 
technical point of view, it is possible 
to operate multiple media on the 
same bandwidth, switching from one 
to another as required. EDUNET is 
also intended to involve all disciplines 
within the university. Some of EDU- 
COM’s projects are for one field, such 
as our plans for networks in bioagri- 
culture and biomedicine. Such en- 



deavors are useful ways to begin, but 
limitation to a few disciplines is edu- 
cationally unsound. Other fields 
would feel neglected if only physi- 
cists, chemists, engineers, and physi- 
cians had access to the new forms of 
information processing. EDUNET is 
also devoted to achieving as soon as 
possible on-demand access by the user 
to information, on-demand access, not 
only to documents but to television 
programs, computerized programmed 
instruction, and all other media. 

We propose to join a number of 
colleges and universities in an experi- 
ment lasting three years or more — 
but for a definitely limited period. 
This experiment would be designed 
to indicate what is feasible and what 
is not, what is worth doing and what 
is not, what is too costly and what is 
reasonable in terms of dollars and hu- 
man effort. The network would be 
operated with one staff and evaluated 
with another, to be sure that the op- 
erators do not bias the evaluation of 
the benefits the system provides to 
the users. 

We propose to establish an EDU- 
NET laboratory with a single director 
supervising a staff at three or four lo- 
cations. One location would be at the 
Research Triangle in North Carolina, 
one in Ann Arbor, Michigan, and one 
on one of the southern campuses of 
the University of California. A fourth 
location might be at an Ivy League 
university. The EDUNET branch 
laboratories would be interconnected 
with four switching stations, possibly 
at San Francisco, Denver, Chicago, 
and Boston. The entire interconnec- 
tion would constitute the kernel net- 
work. 

The first year we would spend ap- 
proximately a million dollars recruit- 
ing a staff and deciding on such ques- 
tions as the organizational structure 






for EDUNET, its operating policies, 
issues of compatibility for harcEvare 
and software, the selection of hard- 
ware for the branch laboratories, 
what materials would be put on the 
network, the selection of long-hne 
services, and how costs would be ac- 
counted for and charged to users. In 
the second year, budgeted at approxi- 
mately three million dollars, narrow- 
band interconnection of the points ^ 
the kernel network would be estab- 
lished and one after another service 
would be put on it. By “nairrow-band 
we mean a bandwidth equal to ap- 
proximately 12 parallel telephone 
channels. 

Whenever any service became op- 
erative, any EDUCOM university 
that wanted to use it could do so. It 
would have to pay the long-line 
charges to the nearest point on the 
kernel network. The university could 
use the service any way it wished to 
on its own campus. If it had a remote 
terminal system or computer syst^ 
which was incompatible with EDU- 
NET, it would have to make the 
transformations required - either 
through a black box or by program- 
ming. Conversely, if they wanted to 
contribute a service prepared on their 
campus to other universities through 
EDUNET, they would have to put 
the information into EDUCOMpati- 
ble format so that it could be carried 
on the network. 

In the third year, we would expand 
the bandwidth to permit two-way 
color television. The cost would be 
about six million dollars. We may be 
underestimating costs. That depends 
on how complex our services become, 
unanticipated operational probl^s, 
and inflation. We are atteinpting, 
however, to keep the costs as low as 
we possibly can so that there is a rea- 
scn^le chance to raise the necessary 



funds. The universities will contribute 
their appropriate share of the funds 
required. The government will not be 
asked to provide the total amount. 
The universities will pay for their 
own terminals, for the long-line 
charges to interconnect with the ker- 
nel network, and for some services. 

Many of the services we put on the 
network will be prepared by govern- 
mental or nonprofit private organiza- 
tions. We have made tentative ar- 
rangements with quite a number of 
such organizations to use their serv- 
ices. Such inputs will of course be 
much less expensive to us than if we 
had to prepare them. A considerable 
amount of machine-readable informa- 
tion is available now to go on such a 
network if arrangements can be 
made. 

The Office of Science and Tech- 
nolo^y has taken cognizance of our 
provi'jsal, has assigned responsibility 
for t to the Department of Health, 
Education, and Welfare, and imder 
HEW to Dr. Louis Bright, Associate 
Commissioner for Research in the Of- 
fice of Education. On various occa- 
sions he has called together interested 
agencies to discuss the EDUNET 
proposal. 

It seems probable that EDUCOM 
may be requested to extend the plans 
for another less ambitious network. 
We have proposed EIN, the Educa- 
tional Information Network, to in- 
clude certain aspects of EDUNET. 

We have had a discussion about 
EDUNET with a member of the 
White House staff. On November 7, 
1967, the President annoimced^ his 
support for the development of “net- 
works for knowledge”. In the Presi- 
dent’s message on education to the 
1968 Congress, be recommended the 
Networks for Knowledge Act of 1968, 
which is Title 9 of the Education Bill 
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of 1968, H. R. 15067. This proposes 
networks almost identical in principle 
to that outlined in the book “EDU- 
NET.” Hearings on this bill were held 
several weeks ago by the Special 
Sub-committee on Education of the 
House of Representatives and the bill 
is now being reviewed in the Senate. 

I have mentioned EIN, the Educa- 
tional Information Network. EDU- 
COM is striving for the ultimate de- 
velopment of an embracing program 
like that of EDUNET. At the same 
time it is important, however, to carry 
on networking activities relevant to 
the missions of various funding agen- 
cies. We have a contract with the Na- 
tional Library of Medicine to plan a 
National Biomedical Communications 
Center which may involve network- 
ing in that field. We have a contract 
with the National Library of Agricul- 
ture to develop a plan, in association 
with the EDUCOM landgrant univer- 
sities, for information transmission in 
bioagriculture. We have an agree- 
ment with the Dental Health Center 
of the United States, when funding is 
available, to work in the area of a 
dental health information system. We 
have a grant under consideration by 
the Office of Education jointly with 
the National Science Foundation for 
the development of EIN, a network 
limited to one of the media, i.e., com- 
puters. Work on the Educational In- 
formation Network is expected soon 
to begin according to the following 
planned chronology: 

Phase I 

1. Engage a limited group (up to 
20) universities in agreement permit- 
ting remote accessing of their com- 
puter facilities. ( More than 20 univer- 
sities have already volunteered to 
cooperate. ) 

2. Establish standard documenta- 
tion format for a description of com- 



putational faciliti( 
produce a director 
tional facilities for ] 

3. Establish tec 
tives at each parti< 
act as liaison and : 
tion about operatic 

4. Set up a rec( 
to identify usage p 
and further plannii 

5. Establish an ( 
supplement the in 
tory. 

Phas 

6. Establish a m< 
mission among 
witli their indivi 
straints. 

7. Develop a sy 
referencing betwee 
putors at participa 

8. Generate an< 
bases for expanded 

We believe tha 
are being spent i 
COM universities 
grams for local co: 
already on comput 
sities. This is tru 
many sorts — foi 
struction, for dat 
computational us 
among others. To 
costs of such dup 
enable a user on ( 
into a computer c 
which already has 
sires, so permittir 
from the work a 
where. 

I have been abl 
some of our presi 
those only briefly 
there will be apj 
programs to the h 
tient-record systen 
education, researcl 
vital that all scient 





34 



al people be able to gain rajpid access 
to relevant information and that our 
institutions be able to sh^e resources. 
Networks can help in this. They can 
enable our universities to become a 
society of universities, to establish in 
our nation universities without walls 
that permeate many activities of our 
country. They can give us democracy 
of access to information. Not only in 
Boston, New York, Chicago, and San 
Francisco will users be able to obtain 
specialized information in depth, as w 
true, but a new college or 
versity wherever it is, a small institu- 
tion in the Rocky Mountains or a fi- 
nancially weak Negro collet in Ala- 
bama can have as good or better ac- 
cess to information as Harvard does. 
Networks can aid in improving the 
general quality of instruction, re- 
search, and professional serv ices 
throughout the nation. 

Discussion Periods — 

Question: Has EDUCOM devel- 
oped relationships with industry? 

Dr. Miller: We have received no- 
strings-attadied grants for EDUCOM 
activities from the General learning 
Corporation from IB\1> and in snial- 
ler amounts, from other corporations. 
VVe also have received a grant from 
RCA to support a conference. We 
have six members-at-large on the 
Board of EDUCOM and fcee of 
those members are from industry. 
Each of them is an individual who is 
distinguished in education, for exam- 

E le, Francis Kleppel, who is well 
nown as an educator and is also 
Chairman and President of General 
Learning Corporation; and Carrol I. 
Newsom, Vice President for Educa- 
tion of RCA, former President of New 
York University. We have also at 
present a representative from IBM 
and one from General Electric. At 
various EDUCOM conferences repre- 



sentatives of the publishing, long-line, 
hardware, and broadcasting indus- 
tries, have participated. While EDU- 
COM is planning a prototype experi- 
mental network, it is not at all sure 
that in the long run it is the responsi- 
bility of the universities to run such 
networks. After we are clearer how 
network services can help universi- 
ties, some industry or industries may 
wish to provide the services on a rea- 
sonable profit-making basis. That 
would be quite acceptable to EDU- 
COM. 

Question: Has EDUCOM devoted 
attention to problems of compatibility 
among local and regional networks? 

Dr. Miller: We may expand the 
EIN study to determine the technical 
characteristics of all the regional edu- 
cational networks, for computers, li- 
braries, television, and so on, in an ef- 
fort to ascertain to what extent they 
are compatible. Millions of dollars of 
local, state, and federal funds are go- 
ing into regional networks of various 
sorts. So far as I know, no one region- 
al network planning group is taking 
informed notice of the technical char- 
acteristics of another in order to be 
compatible. EDUCOM may attempt 
first of all to learn the characteristics 
of present networks. Then, when we 
have developed, in the light of these 
facts, suggestions about what might 
be appropriate standards, we will 
propose them through proper techni- 
cal channels. We are conscious of the 
fact that if you establish compatibili- 
ty regulations too soon you may re- 
strict proper development On the 
other hand, sometimes decisions must 
be made or diaotic waste occurs. I 
personally believe we are near the 
time when we must make such deci- 
sions. We have talked to the Bureau 
of Standards about such matters, m 
well as to other agencies involved in 
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setting standaids. While some stand- 
ards — for television, for example — 
are now well established, in other 
areas there are none at all. We would 
obviously follow Library of Congress 
or Library of Medicine standards or 
others set by responsible bodies 
whenever they exist. In areas where 
standards have not been formulated, 
some group must make the decision. 
Large hardware and software invest- 
ments are being made by universities 
in the current year. If these products 



obtained are so incompatible that 
Wisconsin cannot take advantage of 
developments at Cornell or Cleveland 
State cannot benefit from work at 
California, there will be a great loss 
to all of us. There is danger of a de- 
bacle like the color television hassle 
between CBS and NBC some years 
ago or the battle among the makers of 
different sizes of long-play records or 
tape cartridges. A solution must be 
found soon and EDUCOM is aware 
of the problem. 
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computer which muy or may not fit into 
these educational requirements. 

Innovation in Education 
An innovative device of the scope of 
the computer can be a mixed blessing. 
We have recently begun to enter a new 
era in medical education; one in which 
a half century of educational conserva- 
tism is giving to a receptivity for, 

indeed a hunger for, new and promising 
approaches. As much as many of us re- 
joice at this venturesome spirit, we must 
be wary of its potential pitfalls. Most 
worrisome of all is the capacity of new 
devices to be mistaken for new ideas. 
The act of accommodating old insbuc- 
tion to new packages, such as television 
or the computer, can prove to be worse 
than mere maintenance of the status 
quo. The glossy new packaging tends to 
deceive both the student and the teach- 
er into believing that something new, 
and therefore better, is happening. In 
actual fact, what often happens is that 
considerable energy and money axe in- 
vested in creating a situation that is 
even harder to change than was the 
conventional instruction it is mimicking. 

We have repeatedly seen, for exam- 
ple, the poorly delivered stultifying lec- 
ture become even more so on the TV 
monitor. With sadness I must report that 
the equivalent has begun to OMur 
the computer, in some peoples hands. 
One can now find examples of electronic 

•IMrertor/offfce of Medkd Edooolto Besecrch md Devdopme„t, College of Homon MedMne. 
Michigan State Unioersiiy, East Lansing, Michigan 
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Undergraduate medical education in 
this country is in a state of re-examina- 
tion and revision in proportions without 
precedent. **Efficiency and effective- 
ness” have become watchwords of cur- 
riculum committees. Patterns and tech- 
niques of instruction which had been 
hallowed by decades of use are being 
modified and even jettisoned, and the 
search is on for new instmctional modal- 
ities which hold the promise of getting 
more done in less time. 

The growing sense of need for better 
educational methods has been paralleled 
by an increasing availability of potential 
solutions. ^Vithin the past decade we 
have come to understand the process of 
instruction more precisely and techno- 
logical aids to the process have ap- 
peared in increasing profusion. Pro- 
grammed instruction, teaching ma- 
chines, automatic cartridge movie pro- 
jectors, simplified audio recorders and 
television are all part of the growing 
technology of education. Because of its 
far greater flexibility, potency and cost, 
the computer represents the culmination 
of this trend. 

To understand the promise and the 
problems computers might bring to 
medical education, we must understand 
something of: (1) the process of intro- 
ducing a major mnovation into an edu- 
cational system, (2) the current educa- 
tional requirements in medicine, and 
(3) the particular characteristics of the 
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reincarnations of the pompous, arrogant • 
professor whose instructional strategy is 
the demand of compliance rather than 
the promotion of independent skills in 
the student. The computer generated 
reprimand of “Nonsense! You should 
know better!” fails to help the student 
learn what he did wrong or where to go 
next. Simply put: bad instruction isn’t 
made good by inclusion in a new medi- 
um. The essence of these miscarriages of 
modem methods is that they are at- 
tempts to provide solutions, without 
awareness of the natiu'e of the e.xisting 
problems: they are accommodations of 
conventional instruction to available 
technology, when continuing modifica- 
tion of the instniction itself and adapta- 
tions of the technology are needed. For 
educational innovation to be meaning- 
ful, it must derive from a sound under- 
standing of educational requirements, so 
that available technology can be proper- 
ly modified and exploited, and thereby 
provide worthy solutions. 

Requirements of Medical Education 

A. What We Learn 

I will turn now to some requirements 
of an effective medical education: first, 
in terms of what it is that students must 
learn. 

The most frequent and most desper- 
ate plea one hears today in medicine is 
that we must find ways for dealing with 
the inundation with which we are al- 
legedly faced, as a consequence of the 
“information explosion.” Statistics are re- 
peatedly cited on the multiplying num- 
ber of journals and journal articles as ev- 
idence of this trend. There are two sides 
to this problem which deserve our atten- 
tion. They are neatly highlighted by the 
following quotation: 

“Those who have occasion to enter 
into the depths of what is oddly, if gen- 
erously, called the literature or a scien- 
tific subject, alone know the difficulty of 



emerging with an unsoured disposition. 
The multitudinous facts presented by 
each comer of Nature form, in large 
part, the scientific man’s burden today, 
and restrict him more and more, to a 
narrower and narrower specialism. But 
that is not the whole of his burden. 
Much that he is forced to read consists 
of records of defective experiments, con- 
fused statements of results, wearisome 
descriptions of detail, and unncce.ssarily 
protracted discussions of unnecessary 
hypotheses. The publication of such 
matter is a serious injury to the man of 
science.” 

These timely remarks are taken from 
John Langley’s presidential address to 
the Physiology Section of the Royal So- 
ciety, in 1899 (1). It seems that the in- 
formation explosion, and its accompany- 
ing “garbage explosion,” began some 
time prior to the present decade. 

Most of us would willingly concede 
that much of the seeming explosion of 
knowledge is in truth, a dihition with 
trivia and irrelevancies. There has been, 
however, an undeniable and very con- 
siderable expansion of our understand- 
ing of life processes. I challenge, howev- 
er, the usual implications that are de- 
rived from this expansion. Rather than 
complicating the process of learning, I 
contend that the growth of knowledge 
has actually simplified the process. I 
will turn to some other quotes to help 
make the point. 

“I know that I am shockingly igno- 
rant. I could take exams in college but 
could not pass any of them. Worse than 
that: I treasure my ignorance; I feel 
snug in it. It does not cloud my nriivete, 
my simplicity of mind.” 

This is not the statement of a San 
Francisco “flower child,” it is the obser- 
vation of one of our most distinguished 
scientists, the Nobel laureate, Albert 
Szent-Gyorgyi (2). It was said in a con- 
text that should become clear from the 
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following additional quotes: 

“It is widely spread opinion that me- 
morizing will not hurt, that knowledge 
does no harm. I am afraid it may. Dead 
knowledge dulls the spirit; fills the 
stomach without nourishing the body. 

He points out that we have books and 
libraries “to keep the knowledge in 
while we use our heads for something 
better.” And it is our instructional chal- 
lenge to help students learn to use their 
heads for “something better” than sim- 
ply storing information. A major point of 
this paper, to which I will shortly re- 
turn, is that the computer can help us do 
better jobs of both storing information 
and teaching students to use their minds 
for “something better.” First, let me lin- 
ger one moment longer with Szent- 
Gyorgyi, to emphasize a notion that will 
help clarify the point. 

“Science tends to generalize, and gen- 
eralization means simplification. My 
own science, biology, is today not only 
very much richer than it was in my stu- 
dent days, but is simpler, too. Then it 
was horribly complex, being fragmented 
into a great numner of isolated princi- 
ples. Today these are all fused into one 
single complex, with the atomic model 
in its center. Cosmology, quantum me- 
chanics, DNA and genetics, are all, more 
or less, parts of one and the same story 
— a most wondrous simplification. And 
generalizations are also more satisfying 
to the mind than details. We, in oiu: 
teaching, should place more emphasis 
on generalizations than on details. 

Put in other words, the expansion of 
knowledge has left us with a lighter, 
rather than a heavier, burden. We are 
far better equipped than ever before to 
help our students come rapidly to grips 
with the central, organizing i.ssues of mu: 
disciplines. We can provide the concep- 
tual base which permits the skills of the 
manipulation of knowledge^ the skills of 
acquiring, validating and using knowl- 



edge, rather than the mere possession of 
knowledge, to become the mark of the 
educated man in medicine. It is the acts 
of evaluating and generating knowledge, 
more than retaining it, that seem proper 
goals for our instructional programs. 
And it is in this transformation of goals, 
not in the adoption of new devices, that 
the heart of educational innovation lies. 

B. How We Learn 

Let us turn from what students should 
learn to how they learn. Among the 
many conditions of effective learning, 
two requirements are paramount; First, 
the student must practice, during learn- 
ing, the very things he is to be able to 
do as a result of learning. That is, if he 
is to be able to distinguish abnormal 
from normal heart sounds, he must prac- 
tice that very act. If he is to be able to 
solve clinical problems, he must practice 
the various steps, the components, of 
problem solving. Second, the student 
must have frequent and reliable infor- 
mation on the appropriateness of the 
progress he is making: he must have 
“feedback.” To illustrate: if he is to 
learn to swing a golf club, he must not 
only get to see where the ball goes as a 
result of his efforts; he will make his 
most efficient progress if he can see a 
movie or videotape of his actual swing 
and he is helped to see the crucial com- 
ponents of the total skill, such as the po- 
sition of his head, the line of his shoul- 
ders, his stance, and so on. Similarly, if 
the student is to learn to solve medical 
problems, he needs to know the correct- 
ness of his solutions, but he also ne^s 
to know his competence at managing 
the crucial components of the process; 
such as problem sensing, problem for- 
mulation, information search and resolu- 
tion. These skills have been identified 
and elaborated by Shulman ( 3) . 

While the earning of intellectual skills, 
such as problem solving, is far more 
complex than the learning of mechanical 
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skills such as golfing, we have been con- 
siderably less effective than golf instruc- 
tors in providing the exquisitely impor- 
tant ingredient of meaningful feedback. 

To recapitulate, I suggest that among 
the central challenges of current medical 
education are: (1) developing tech- 
niques for helping students learn to ef- 
fectively manipulate knowledge, (2) en- 
abling them repeatedly to practice these 
manipulations, and (3) providing fre- 
quent and reliable feedback on their 
success at the overall process, and at its 
components. Computers have a unique 
set of characteristics which, if properly 
exploited, can fulfill these requirements 
with remarkable effectiveness. 

Characteristics of Computers 

The specific characteristics of modem 
computers and the ways in which tlicy 
function, have been well described in a 
recent publication by Caffrey (4), in- 
tended primarily for technically unin- 
formed readers. The general characteris- 
tics with which I will here deal are 
those matters which provide the com- 
puter with its special potential as well as 
its limitations, as an educational device. 

Among the computer 's greatest 
strengths are the SPEiiD with which it 
can search its memory, undertake a cal- 
culation or solve a logical problem, the 
PATIENCE with which it will systemat- 
ically repeat questions or otherwise deal 
with refractory students, the nearly un- 
limited capacity of its MEMORY for 
storing all manner of information, the 
IMPARTIALITY with which it will deal 
with different students and changing 
characteristics within the same student, 
the consistent LOGIC with which it 
handles sequential information or intri- 
cate problems, and its ADAPTABILITY 
to wide variations in tlie manner of pres- 
entation of the same problem through 
the availability of virtually unlimited ca- 
pacity for branching to alternate possi- 



bilities. In the process of performing all 
these functions, it can keep complete 
records of the entire proceedings. As we 
will see shortly, this is a singularly im- 
portant function for educational pur- 
poses. 

Among the more serious of the com- 
puter’s limitations in performing the 
kinds of educational challenges it tends 
to be given are its FLEXIBILITY 
being limited as it is in its responses to 
the finite repertoire which its program 
necessarily provides, its essential lack of 
ORIGINALITY, in comparision to the 
human teacher with which it is so often 
compared, its FALLIBILITY in terms of 
the electromechanical breakdowns to 
which current computers remain prone, 
and its essential lack of PERSONALI- 
TY, or patently synthetic programmed 
personality, which remains a somewhat 
jarring characteristic to many students 
who are otherwise caught up in the hu- 
manoid characteristics of the interaction. 

The process of adapting the computer 
to the instructional requirements in 
medicine must include the extraction of 
maximum advantage from its strengths 
and careful accommodation to its limita- 
tions. 

Computers in Undergraduate Medical 
Education 

Before discussing the computer as an 
instrument of direct instruction, I will 
briefly mention some of the ways it can 
increase the efficiency and capabilities 
of administrative functions which sup- 
port the overall educational system. Al- 
though they are not seen as part of the 
purposes of the present paper, they are 
mentioned for completeness. The proc- 
esses of student record keeping, class 
and patient scheduling, educational 
budget management and the develop- 
ment of a reference memory on a variety 
of relevant subjects are all parts of the 
computer’s potential contribution to ed- 
ucation. 'They have been discussed by 
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Caffrey (4). The exceedingly important 
functions of library maintenance and 
management have been described by 
Brandt (5) and will be elaborated upon 
in this conference by Dr. Martin Cum- 
mings. 

The remainder of this paper will be 
devoted to those educational applica- 
tions in which the student receives in- 
struction through direct contact with the 
computer, using a remote terminal. This 
consists of a typewriter-like apparatus 
which permits both the student and the 
computer to ask and answer questions in 
a fairly free exchange. There may be, in 
addition, a television-like tube for the 
display of printed information or dia- 
grams, as well as computer controlled 
slide projectors, movie projectors, and 
audio recorders, for providing the stu- 
dent with sensory inputs of various 
types. I will briefly examine the four 
major types of educational uses within 
this setting. 

A. Information and Concepts 

Conventional medical education is so 
information oriented that it is no sur- 
prise to find that a fair proportion of 
early computer based instructional pro- 
grams have been primarily information 
oriented. A fairly typical illustration of 
the strategy employed is represented by 
the model adapted from Spolsky (6) in 
Figure 1. This model, it will be noticed, 
takes advantage of the adaptability, log- 
ic and patience of the computer to sys- 
tematically check, and if necessary cor- 
rect, the progress of the student in ac- 
quiring a DO^ of information. It should 
be dear that me computer is fully capa- 
ble of drilling students in the acquisition 
of information. Information acquired in 
this way, however, will generally not 
last long. Information of the complexity 
required in medicine, paradoxically, is 
acquired best when it is not the primary 
center of attention, hut is part of appli- 
cations that are meaningful to the stu- 



dent. As discussed earlier in the paper, 
information that is not alive and vivid 
for the student is best left to books or 
some other repository. 

*~B. Intellectual Skills 
Essential in its relevance to the gradu- 
ate physidan, and hence to the student 
physician, are the skills of identifying 
and solving problems, generating and 
testing hypotheses, and formulating 
judgments. The characteristics of the 
computer make it possible to present the 
student with repetitive instances of 
these procedures for practice and mas- 
tery. It is here, it seems to me, that the 
computer holds its greatest potential in 
undergraduate medical education. Re- 
turn to Figure 1 and imagine, if you 
w'ill, a problem oriented, rather than an 
information oriented, program. The er- 
rors that the students here make are 
process rather than content errors, and 
tlie remedial assistance they are given 
deals with the components of the intel- 
lectual skills being learned, rather than 
with facts being acquired. For example, 
they might be alerted when they draw 
an unwarranted inference or arrive at a 
judgment with insufficient evidence. 
And, most important of all, the comput- 
er’s capacity to retain a total record of 
all transactions in which it engages, en- 
ables the student to be provided Nvith 
the cognitive equivalent of a video-tape 
of his thought processes. In fact, the 
computer print-out of the problem-solv- 
ing process in which the student has en- 
gaged is far more flexible than a 
video-tape. It is more like a map which 
can be scanned in its entirety and com- 
pared to other maps, for critical evalua- 
tion. Much like the golfer who makes 
startling progress through being con- 
fronted with his own swing, the medical 
student learning intellectual skills, when 
provided with the feedback of the 
print-out, can make unprecedented 
strides in areas previously barely 
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touched by conventional medical educa- 
tion. 

C. Technical Skills 

The flexibility of the computer, com- 
bined with a multimedia terminal, per- 
mits the student to be presented with 
wide varieties of EKG tracings to be in- 
terpreted, slides to be read, or heart 
sounds to be deciphered, to mention 
only a few of the possibilities of instruc- 
tion in technical sldlls where student re- 
sponses can be immediately judged and 
repeated practice provided. An even 
more sophisticated possibility is the 
creation of complex simulation situa- 
tions, such as "Sim I,” developed by Drs. 
Stephen Abrahamson and J. D. Denson 
for the training of anesthesiologists. 

D. Evaluation 

The capacity of computers to keep a 
complete record on all its transactions 
with students permits an unusually com- 
prehensive and elaborate evaluation, 
both of student performance and in- 
structional effectiveness. The singularly 
attractive possibility which emerges is 
that of computer-monitored instruction. 
In a way we have never been capable of 
doing in the past, student progress can 
be assessed from day to day, rather than 
term to term, and instructional adjust- 
ments made, literally, as needed. The 
extent to which this can elevate our effi- 
ciency can, at present, barely be imag- 
ined. In addition, the memory and adap- 
tability of the computer permits the de- 
velopment of a store of great ranges of 
evaluation materials, which students can 
use at any time to assess their own prog- 
ress along many dimensions of any disci- 
pline. Still further, formal accreditation- 
type evaluations can be undertaken 
more flexibly and more reliably with the 
computer. An imaginative new comput- 
er-based techrrique for evaluating stu- 
dents of large differences in ability, in a 
marmer that exposes tliem to a unique 
set of questions which are maximwy 



adapted to their level of performance, 
has been described by Chauncey (7). 

CONCLUSIOm 

The computer, without question, pro- 
vides the potential for an enormous 
technological leap forward in education. 
Its long range promise and conse- 
quences can barely be glimpsed, if rec- 
ognized at all. Many of the steps, how- 
ever, which must now be taken to help 
us profit most from this potential, can 
reaaily be seen. 

Most important is the need for us to 
identify, as explicitly as possible, the 
real purposes of medical school instruc- 
tion. We must then define, as precisely 
as we are able, the characteristics and 
components of the competencies our 
students are to acquire. These must be 
formulated in terms that duplicate or 
parallel the circumstances in which they 
will actually be applied following grad- 
uation, so the practice we provide our 
students in school will be maximally rel- 
evant and real. Provision must also be 
made for effective feedback to the stu- 
dents on their success in acquiring these 
compentencies. 

A burning question in the minds of 
many is: if we succeed in properly ex- 
ploiting the potential of the computer, 
will the live teacher be displaced? In an 
observation that is equally relevant to 
computers, B. F. Skinner has said that, 
“Any teacher who can be replaced by a 
teaching machine, deserves to be." T!ie 
point is this: the computer can, indeed, 
do certain things better than the live 
teacher. It was more than a half century 
ago that Thorndike observed, "a human 
being should not be wasted in doing 
what forty sheets of paper or two phon- 
ograph records can do. Just because per- 
sonal teaching is precious, and can do 
what apparatus caimot, it should be 
saved for its peculiar work." (8) The 
challenge before us is not how to sup- 
press computers so as to permit teachers 
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to go on doing those things they no 
longer need to do. The challenge is, 
rather, to exploit computers to their 
maximum and, at the same time, work to 
redefine the human teacher’s role so that 
we may take full advantage of his po- 
tential, which no machine of Ae foresee- 
able future will possibly duplicate. 

No innovation of this potential magni- 
tude is without risk. Shall we wait until 
all the data are in and move forwwd so 
delicately and with such caution that all 
false starts and errors will be avoided, or 
should we acknowledge the enormom 
promise now available to us and forth- 
rightly and vigorously take some 
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SUMMARY 

COMPUTERS IN UNDERGRADUATE MEDICAL EDUCATION* 

Pond: Hilliard Jason, M.D., Ed.D., Chairman, Stephen Abrahamson, Ph.D., Alan Kaplan, M.D., 
Theodore Peterson, Ph.D., Lee S. Shulman, Ph.D. 



It is not possible to give credit in a 
sununary like this to everyone’s favorite 
idea. As a matter of fact, it is difficult to 
include the most salient points of a 
three-hour discussion. However, this pa- 
per will attempt to give at least an over- 
view of the major ideas discussed. 

Our approach was first to take a look 
fit the present state of the use of com- 
puters in undergraduate medical educa- 
tion. Dr. Theodore Peterson reported as 
to the work underway at Harvard Uni- 
versity, some generalities based on their 
work and their summary of the work of 
others. Dr. Lee Shulman helped us look 
into the future to some new ways com- 
puters might be used in achieving some 
objectives, particularly in the area of de- 
veloping the processes of medical in- 
quiry. Dr. Stephen Abrahamson helped 
us stay reality-oriented with his very apt 
and effective reminders of the ap- 
proaches that are necessary to evaluate 
properly what we are doing as we do it, 
end Dr. Alan Kaplan of the Bureau of 
Health Manpower provided perspective 
as to the hopes, wishes and plans of the 
federal government in the area of sup- 
port of computers in medic^ education. 
In order to bring some coherence to a 
rather free-flowing and not always s^- 
tematlc discussion, ei^t general conclu- 
sions derived from the mscnissions will 
be presented. In addition, Dr. Shulman’s 
comments will be presented as an ap- 
pendix to this summary. 



The first conclusion which can be 
stated with some acronymity, is that 
computers in undergraduate medical ed- 
ucation are not yet in what might be 
called an implementation phase. Any 
school that does not now have a com- 

E uter should not feel that they are some- 
ow missing out on an important 
contribution to their education program. 
In fact, this leads to the second general 
conclu^on, which is, that the primary 
justification for having a computer 
would be for a few iimovative and even 
unique studies of its utility and effec- 
tiveness in medical education. 

The third conclusion which ties into 
the first two, is that the issue of cost in 
the use of computers is a complex but a 
seemingly important one, and there 
seemed to emerge two different posi- 
tions regarding cost in the ways comput- 
ers might be used in undergraduate 
medical education. When computers are 
used to do something that is already 
being done, then cost was an exceeding- 
ly important consideration. The ratio of 
cost to effectiveness was one of the cen- 
tral issues in determining whether what 
we now do can possibly be done differ- 
ently or better with a computer. But 
there was a second position and that is 
of the possibilities that computers bring 
that may enable us to do things we 
aren’t doing at all now and may enable 
ris to realize instructional objectives that 
are not available now. In areas like this. 
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cost becomes £i far less important con- 
sideration. That is, if we can use the 
computer and our studies of it to help us 
produce a physician of higher quality 
than we have produced before, then cost 
is no longer an issue. Our dedication has 
been that if we can produce something 
really worth producing, cost becomes a 
secondary issue. 

A fourth general conclusion is that the 
technology of the computer seenas to be 
considerably ahead of our readiness to 
take full advantage of it. The most cen- 
tral and most pressing need that was re- 
peatedly identified was the urgency 
with which we need a far better delinea- 
tion of our objectives in undergraduate 
medical education. These are not the 
broad, philosophic, abstract program ob- 
jectives of trying to produce good physi- 
cians; these are the hard-to-define but 
exquisitely important instructional ob- 
jectives that commmunicate what are in- 
deed the specific competencies that a 
graduate will have, if we are to regard 
him as a worthy graduate of our school. 
TTiese have never been defined, and as 
has been said before, if you’re not sure 
where you’re going you might end up 
somewhere else. The need for precision 
in defining objectives does not require 
government support, it does not require 
hardware; it does require the conscien- 
tious dedication of medical educators to 
the task of working together and coming 
to grips with what it is a physician is 
going to be able to do. Not only what he 
^ going to be able to know, but what he 
is going to be able to do, if we have con- 
fidence in him and in the quality of our 
instruction. The important point is, that 
whether we go about doing that expli- 
citly or not, we have done it. Without 
defining objectives explicitly, we have 
defined all sorts of objectives implicitly, 
just by doing what we do when we as- 
sign a particular class to a particular 
topic. That is a definition of objective. 



By failing to be explicit in objectives, 
run a terrible risk of which we were 
minded several times on the panel. T! 
is, the risk of achieving some objecti' 
at the expense of more important on 
that by helping students work in a p 
ticular area we might be failing to h 
them learn how to work in another ai 
For example, if we have studerits d( 
very significant portion of their in 
pendent learning on a computer, 
we perhaps running the risk of failing 
help them with the important skills 
learning how to learn without a comj 
er? There are more important questi 
than that, and these relate to our c 
rent examination system. We commi 
cate to students most effectively w 
our objectives are by the exams we 
sign. Another way of communicating 
fectively our objectives is by investin 
great deal of effort into what we put 
side a computer. If we convey a loi 
ephemeral details and very short-li 
information because that s what is i 
iest to put into a computer or easies 
examine on paper and pencil tests, t 
we are communicating to them fur 
mentally that learning is not a very r 
vant activity, and that the act of par 
pating in medical education is a gi 
which you play in order to get a deg 
Then you end up with one of the g 
tragedies of medical education in Air 
ca; the production of generations 
physicians who are committed to the 
tion that learning is something they 
spend the rest of their career avoid 
If we don’t design our programs, oui 
tal educational programs, and our c 
puters in a way that helps physic 
develop the skills and dedication to ■ 
tinue to modify themselves the res 
their lives, anything else we do is o 
importance. 

The fifth general conclusion that 
in very closely with the last, is tha* 
tuition just isn’t enough in educati 
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planning or computer usage in medical 
education. Intuition has led to a pro- 
gram of medical education in this coun- 
try that can safely be described as rigid 
in the extreme. Despite the evidence of 
iho remarkable diversity among medical 
students, we have somehow intuitively 
fashioned the program that tries to pre- 
tend that everybody learns in the same 
way, at the same speed, and is interest- 
ed in the same things. All of this flics in 
the face of everything we know about 
people. So that if we arc going to use 
computers intelligently, we need to put 
aside intuition because it has failed us, 
and we have to start assembling data. 
We have to build into our computer us- 
age a very generous allocation of funds, 
time, and effort; to start a process of 
evaluation of what we are doing; and to 
develop a research base that will guide 
us in the future. A specific suggestion 
finding favor was the idea of encourag- 
ing and developing regional efforts at 
research in medical education and var- 
ious parts of medical education — cate- 
gorical sub-parts of the total picture. 

TTie sixth general conclusion would be 
that it is inexcusable to undertake a 
project today ir the use of computers in 
undergraduate medical education with- 
out a major investment in evaluation of 
the process. 

The seventh major conclusion was 
that the promise or computers for un- 
dergraduate medical education is enor- 
mous, indeed. It brings more than just 
its own utility; it is having the heuristic 
effect of forcing us to cla^ our educa- 



tional objectives more precisely than wo 
ever have before, of promoting a re- 
thinking of our purposes and a re-think- 
ing of our methods that is long overdue. 
More significant still, besides being ca- 
pable of direct instruction and being ca- 
pable of direct evaluation of students, 
the computer is capable of storing its 
own processes as they are conducted 
and becomes a remarkably effective tool 
in evaluating its own functions with our 
direction and with our design. 

The eighth and final major conclusion 
is finding the proper balance between 
the live teacher and the technology rep- 
resented by the computer, which is the 
greatest cnallenge tiiat we face. Our 
challenge is not only to use the comput- 
er intelligently, but to re-define imagi- 
natively flie role of the live teacher be- 
cause so much of his time and effort in 
undergraduate medical education is now 
devoted to things we already know can 
be done better by technology. If we are 
going to provide a quality medical edu- 
cation, if we are going to undertake the 
remarkable complex transformation of a 
college student into a professional posi- 
tion, we have to provide him with effec- 
tive models of what it is we want him^ to 
become. VWiat we need is the aeation 
of live teachers who will embody, will 
not just espouse but will embody those 
things we have decided we want our 
students to become. This a machine can 
never do and this is where the proper 
role of ^e live teacher begins to be de- 
fined and this is where much work re- 
mains to be don& 



INQUIRY, COMPUTERS AND MEDICAL 
^ EDUCATION* 



lee S. SHULMAN, PH.Dt 



I speak to you as someone encaged to 
the study of the manner in which people 
learn, organize what has heen learned 
and employ that organized bodv of 
knowledge in the service of solving 
prohlems. I label this process ingulf, 
after John Dewey. An examination of in- 
quiry can provide educators conremed 
with the teaching of future physicians a 
source of monitoring, evaluation and 
modeling that will serve them exactly as 
we have claimed the computer can serve 
the student We say that it is important 
for the student to receive appropriate 
fe^back so that he has a constant per- 
ception of how closely he is approximat- 
ing some ideal model of how a physician 
(wSrates. If we as educators are going to 
mesurne to program the c^puter to 
provide that kind of service for the stu- 
dent, we need very clear ideas in our 
cwn minds of what are the mtOTra 
models of medical practice, m^cal di- 
agnosis, interviewing, history taking Md 
ph^ical examination. These are the 
modek which the computer must ot- 
ploy. We ought to specify these models 
feire we design any program. I do not 
know that we have accomplished this, as 
yet 

tod of 

model? One approach, which we might 
c^ the experience model, is to make 
careful observations of men and women 
who are identified hy the community of 



medical ’practitioners and scholars m 
being criterial physicians. Thwe indiidd- 
uals represent in their behavior the fin- 
est kind of medical practice we can 
identify. We then attempt to abstract 
from a careful analysis of what they do 
under various conditions, and finally 
employ that abstraction as the model we 
put into our computer so that it, in tu^ 
can now react and give feedback to the 
medical student who is learning. Tlus is 
the sort of thing that is done in the heu- 
ristic programming of a computer to 
play chess or prove mathematical th^ 
rems. We do not have in the medical lit- 
erature extensive studies of the act^ 
behavior of fine diagnosticians in s^- 
cient detail to lead us to a model such m 
this one. This kind of research wll be 
necessary in order to make medical m- 
struction significantly more effective. 

The second approach is to develop 
logical models. We ask ourselves, not 
how do good practitioners practice or 
good diagnosticians diagnose, hut rather 
what appears logically to be Ae model 
for inquiry, be it medical inquiry or any 
other tod of inquiry. The iDustrative 
model I shall now describe, in simplified 
form, is derived from Dewey’s philoso- 
phy of inquiry. It has directed my re- 
search efforts over the last six years. 

A Model of Inquiry 

We begin with the stage of problem 
sensing. Most real inquiry does not be- 
gin the way we represent it in schools. 
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Tliere, we present students wth prob- 
lems to solve which have already been 
very carefully fomaulated. Rather, much 
of inquiry in a natural setting begins 
with the problem solver or inquirer 
being placed in a situation that is terri- 
bly ambiguous and undefined — where 
the edges are blurred and the distinc- 
tions are not clearly made. His first task 
is to sense where the problems lie and to 
distinguish what is problematic from 
what is not. We all recognize that two 
individuals can encounter essentially the 
same situation, which one of them will 
see as problematic while the other will 
merely nod and go on. Problem sensing 
is a very subtle kind of process. We do 
painfully little to train people in prob- 
lem sensitivity. It may be, however, 
differences in the ability to sense prob- 
lems that distinguishes the medical thor- 
oughbreds from the horses that pull the 
milk wagons. 

Once a problem has been sensed, it 
must be put into words or categories. 
That is, it must be formulated. John 
Dewey observed that a problem well 
formulated is half solved. The manner in 
which wc formulate any sensed problem 
delimits the kind of resolution that we 
are capable of generating. A problem 
fonnulation determines the kinds of in- 
formation we are going to seek out in 
our search, the kinds of hypothesK we 
will entertain or reject, and the kind of 
solution that we ^vill admit as possible. 
Problem formulation is the second stage 
or aspect of inquiry. 

The third is search. Scorch can be 
both external and internal. We not only 
conduct search by asking questions of 
patients, performing a ph^ical examina- 
tion, calling for certain kinds of l.-’hora- 
tory tests and generally gathering infor- 
mation from the outside. There is also 
internal search. We have enormous 
storehouses of information between our 
ears and, potentially, in our computers. 



The question is how much of this infor- 
mation do we seek, and which of it do 
we seek? The interaction of the internal 
and external information-gathering con- 
stitutes this total process of searching. 
The search is defined as the sequence of 
operations, questions, movements, frus- 
trations, revisions of tactics, and the like, 
that the individual undertakes in order 
to transform the problem-as-formulated 
into a personally-felt resolution. 

Problem resolution occurs when we 
decide that wc are finished and the 
problem which initially keyed off the in- 
quiry is solved. In the studies we have 
conducted of inquiry in teachers, we 
find enormous variability among indi- 
viduals in what they will accept as a res- 
olution of a problem. This is closely re- 
lated to their formulation, but it is also 
related to individual differences in per- 
sonality, values, intelligence and train- 
ing. Unfortunately, differences attribut- 
able to training are usually accidental, 
because rarely do we have a clear model 
in mind when wc engage in instruction. 

It is very important to note at this 
point that the model of inquiry de- 
scribed above does not require a rigid 
sequential ordering of steps wherein all 
inquiries can be subdivided into four 
simple stages representing each of the 
four above-named processes. The natu- 
ral process of inquiry has these four 
parts as somewhat independent compo-- 
nents. Any particular inquiry wll look 
very much like a computer program 
wth its many loops and digressions. The 
steps of inquiry act as the basic opera- 
tions in the program. Thus, it would not 
be unlikely for a given subject to sense 
that a particular problem exists, proceed 
to formulate it in a particular way, initi- 
ate search activity in order to gather 
data concerning the problem, realize M 
a result of the initial search that his 
problem formulation is misbegotten, re- 
turn and reformulate the problem, while 
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doing so sense an additional problem or 
two, thus reformulate once again, and so 
on. 

Medical Inquiry 

What happens when vou take this 
kind of model and attempt to apply it in 
the context of the medical situation? 
The diagram of Figure 1 suggests that 
the input of a specific case interacts 
with the organized body of knowledge 
possessed by the physician, his long and 
short-term expectancies of what he will 
encounter and the general strategies or 
heuristics he has learned, to generate as 
output the medical diagnosis, treatment 
and evaluations. The full complexity of 
medical inquiry is surely not represent- 
ed in this diagram. The relations be- 
tween tliis model of medical inquiry and 
the general inquiry model are only sug- 
gested here. A far more detailed analysis 
must await much additional effort. 

I think it is fair to say that tlie acqui- 
sition of organized bodies of knowledge 
has been the major focus of discussions 
in this conference, with the assumption 
that the computer is useful in making 
more efficient and effective the manner 
in which these bodies of knowledge are 
acquired and organized. Not yet an- 
swered satisfactorily is: How do alterna- 
tive ways of organizing a body of 
knowledge have different consequences 
for directing the process of inquiry? 
This is the name of the game in medi- 
cine, as it is in teaching and in other 
complex problem solving tasks. We 
teach the organized bodies of knowl- 
edge, not to create little living libraries 
of our subject, but rather to make these 
bodies of Imowledge maximally retriev- 
able and useful in the service of inquiry. 
Is Socratic teaching, whether live or by 
computer, the most effective way of ac- 
complishing this? Is drill to the point of 
overlearning the most effective way? 
The most general question for the differ- 
ent aspects of the inquiry process we are 



trying to teach in medicine is: Which 
approaches to learning are most likely to 
assist us in achieving our multiple goals? 

The computer must be introduced 
into the flow of medical instruction as 
part of a systematic strategy of educa- 
tional development. First a map of ob- 
jectives must be drawn in very specific 
and operational terms. These wUl include 
organized bodies of knowledge, certain 
kinds of expectancies on tlie part of the 
physician, and strategies of inquiry. All 
these affect the conduct of medical in- 
quiry. The future impact of the comput- 
er on the practice of medicine is likely 
to be reflected in a shift of instructional 
emphasis awav from the organized bod- 
ies of knowledge to the strategies of 
knowledge-retrieval and inquiry. Next, 
the materials representing possible paths 
to the terminal objectives must be devel- 
oped. Third, the materials and objec- 
tives must then dictate the combination 
of software and hardware most ap- 
propriate to guiding oiu* students in 
traversing the map. Fourth, the total in- 
structional system so designed must be 
implemented under carefully monitored 
conditions. Finally, the results of that 
implementation must be evaluated in 
terms of the original map of objectives. 
This evaluation could lead to changed 
instructional tactics, modifications in the 
map, or both. If we too quickly try to 
move into the implementation stages 
without prior, or at least simultaneous, 
effort in the planning and design stages, 
we are likely to generate more chaos 
than progress. 

'Research in Medical Education 

I shall conclude with an urgent plea I 
make not only to medical educators but 
to educators of all lands. For too long 
we have allowed complex and expensive 
educational operations to be piloted by 
the scats of our pants. We decide what 
we do on the basis of our reactions to 
what was done to us. This can work in 
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two ways. We can cither repeat our own 
experiences or react against them and 
do the opposite. Both axe equally unten- 
able. 

We must get beyond this level of 
doing things just because we intuitively 
feel this is the best way to do it. We 
must attempt to study carefully the 
processes in which we are engaged. I 
am not suggesting that people in medi- 
cal education run to the studies of B. F. 
Skinner and try to extract his findings 
and apply them directly to medical edu- 
cation. TTiat will not succeed, because 
medical cduc.ation is not the same as 
teaching pigeons to play ping pong or 
even 6-year-olds to count. Rather, we 
need to create a discipline of the psy- 
chology of medical education that will 
beer a relationship to the general psy- 
chology of education and learning — a 
relationship that is parallel to the rela- 
tion medicine as a discipline bears to the 
basic sciences. Clinical medicine is an 
intermediate discipline betxveen the bas- 
ic sciences and direct medical applica- 
tion. The applied disdpline of the psy- 
chology of medical education must have 
analogous characteristics. It does not 
now exist except as a set of intuitively- 
derived dogmatic statements. How can 
the creation of this field be accelerated? 

The scope of systematic research 
which is needed in medical education is 
great. In order to achieve that scope as 
quickly as possible, we must implement 
broad programs of research in medical 
teaching and learning, making best pos- 
sible use of the small number of current- 
ly active personnel in that field. 

A strategy I would recommend for’ 
your consiucration is the following: Let 
us establish a series of Medical Educa- 
tion Research Laboratories around the 
country. They could be organized on ei- 
ther a regional basis, or through joining 



together units which share interests but 
may be in different parts of tlie country. 
Each laboratory would be dedicated to 
a specific research mission in medical 
education and would draw upon the rc- 
soxurccs, facilities and research popula- 
tions of all its cooperating units — uni- 
versities and hospitals. Such missions 
might include the specification and defi- 
nition of objectives for medical educa- 
tion, the development of evaluation 
models and evaluation instruments in 
medical education, the uses of technolo- 
gy including the computer, the study of 
the medical inquiry process and studies 
of the acquisition and use of organized 
bodies of medical knowledge. 

Tlie M cdical Education Research 
Laboratories must also assume a train- 
ing function in order to produce the re- 
search and development persoimel need- 
ed to disseminate, implement and evalu- 
ate the research-oased approaches 
which emerge from the laboratories. 
This medical education research effort 
cannot be left to individual medical 
schools, but must be coordinated sys- 
tematically on a nationwide basis. 

Ivan Pavlov is said to have told his 
students, “Ideas and theories are like the 
wings of birds — they allow man to 
climb and soar to the heavens. But facts 
are like the atmosphere against which 
those xvings must beat, and xvithout 
which the soaring bird will surely plum- 
met back to earth.” We are at a moment 
in the history of medical education 
when we must buttress our myriadic 
ideas and theories about the best forms 
of medical education xvilh painstakingly 
collected facts. In this effort the com- 
puter xvill be an indispensible tool. 
Without this research effort, the com- 
puter in medical education could be- 
come our newest enemy. 



COMPUTERS IN CLINICAL MEDICAL EDUCATION 

DONALD A. B. LINDBKRC. M.D.* 



There are a number of sources 
from which one learns clinical medi- 
cine. Computer systems have poten- 
tial roles to play in providing access 
for the student or physidan to infor- 
mation. We will examine examples of 
such systems. 

The student or physidan leams 
about medidne from four major 
sources. These sire: conurion sense 
and lay beliefs; by examining the 
facts of patient care; hy exposure to 
purely didactic information, and from 
the personal guidance and precepts 
of his teachers. 

Facts of Patient Care 

One leams medicine from the op- 
portunity to personally care for pa- 
tients or to see care given. This is a 
valuable, but limited experience. One 
cannot see examples of each and ev- 
ery disease, treatment, outcome, and 
evaluation of such processes. Conse- 
quently one leams by drawing upon 
the experience of a whole institution. 
A computer system can provide valu- 
able assistance merely by serving to 
retrieve patient records, to search the 
hospital files for records, and by per- 
mitting comparisons to be made be- 
tween different groups of patients or 
different treatments or management 
schemes. (1) (2) 

In such cases the real learning is 
done by the student reading and 
studying the usual ^vritten hospital 



record. The computer has merely 
guided him to the correct record. 

Inquiries into the records of labora- 
tor)‘ determinations can also be a 
source of learning. Systems have been 
provided so that the inquirer can see 
the frequency distribution of results 
of a determination during past hospi- 
tal experience, and so place his pa- 
tient’s results in a perspective of the 
institutional experience (3). The sys- 
tem provides the ability to retrieve 
any item of laboratory studies for any 
patient, or alternatively to retrieve 
and display categories of results 
(stich as, those patients with choles- 
terols greater than 300 mg^) or by 
compounding categories (such as by 
also requiring that the patients be of 
a particular race, or sex, or that the 
results have occurred during a certain 
time period). It is also possible to re- 
quire in such an inquiry that the re- 
sults -of a second or of a third deter- 
mination also meet certain specifica- 
tions. The net result of such com- 
pounded inquirie.s is merely the dis- 
play of data or the listing of paHent 
identification numbers — nothing 
creative or innov’^ative. Yet such a fa- 
cility permits the student or physician 
to ask questions of the mass of poten- 
tial “teaching data” which might oth- 
erwise he difficult to use via manual 
record room systems. 

An additional benefit of the facility 
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to retrieve the results of laborator)' 
determinations is provision to the lab- 
orator)’ director of added quality con- 
trol capability. He can, for example, 
.specify very closely the format of re- 
ports, the requirements for release of 
a report (i. e. tolerable “limits” and 
special rules), the permissible preci- 
sion for reporting, the extent to which 
c|uality control sera for a given batch 
run may var\’ from the most precise 
estimate, the extent to which aqueous 
standards may vary from their 
expected curvilinear relationship. The 
laboratory director can take into ac- 
count the relationships between the 
results of multiple simultaneous de- 
terminations in formatting his “limits” 
systems (•!). A simple example of this 
Idnd of rule is the requirement that 
hemoglobin concentration and hema- 
tocrit bear a .sensible relationship to 
one another when both estimates are 
available for the same blood sample. 
Computer systems for examination of 
laboratory determinations can permit 
the laboratorian to ask such cpicstions 
before erroneous reports creep into 
the patient care system, WTien reports 
dcsiate from the "limits” ss’stems, the 
resident physidan has an opportunity 
to re-examine the situation and ap- 
prove or disapprove the report. Such 
constant re-examination of premises 
and performance as well as the crea- 
tion of new limits and rule.s serves an 
educational and training function for 
the house officer and the laboratory 
director as well. At the veiv’ least, 
such systems direct ones attrnMon to 
the exceptional clinical case, ideally 
the case requiring professional inter- 
vention and judgement. 

Didactic Information 
The published medical and sden- 
tific literature is indexed by the Na- 
tional Library of Medidne, publish- 
ers of the Index Medicus. This cita- 



tion data base itself can be searched 
by the NLM computer sj’stcm, and 
hopefully this system will be replicat- 
ed at many other medical centers 
(5). 

There is now the potential to store 
considerable quantities of information 
on microfiche s)*stcms, which in turn 
can be indexed by computers (6). At 
present one cannot (practically 
speaking) transmit the images of mi- 
crofilmed text pages over long dis- 
tances. Perhaps image transmission 
(e, g. “Picture Phone”) will in the fu- 
ture make a reality of the dream of 
browsing through the library via the 
computer. 

An experimental program at Mis- 
souri (called Consider) attempts to 
allow the student or physidan to .scan 
across a broad spectrum of medical 
knowledge. The data base employed 
is a magnetic tape version of the 
AMA Current Medical Terminologs* 
(CMT), kindly provided by Dr. Bur- 
gess Gk)rdon, Our programs permit 
the inquirer to type onto a computer 
terminal a statement rf the signs, 
symptoms, or other findings from a 
patient. The system then searches the 
formatted statements of CMT and 
displays for the doctor a list of the 
names of diseases in which the find- 
ings occur in the combinations speci- 
fied, and hence which must be con- 
sidered. Medical students have found 
the program challenging and often 
educational. It is amazing how long a 
differential diagnosis one can encoun- 
ter and how often the teacher has for- 
gotten much of what is contained in 
Dr. Gordon’s slim volume. 

Recorded audio medical lectures 
have been developed at the Universi- 
ty of Wisconsin (7), Under such a 
system, the user can telephone to the 
message center, request a particular 
lecture, and get the benefit of a care- 
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fill presentation without leaving his 
office. The original audio tapes have 
been loaned by Wisconsin to various 
Regional Medical Programs and othCT 
educational groups. At Mi«o^ the 
Wisconsin tapes are utilized through 
an automatic answering apparatus so 
that the operation is totally unattend- 
ed. The critical ingredient in suA a 
system clearly is Ine necessary high 
quality of the lecture material. 
puters enter the picture only on the 
technical side. S^vitching many in- 
coming calls behveen hundreds (ot 
potentially thousands) of recorded 
lectures will be a computer job. Simi- 
larly, providing systems so that me 
medical user may learn of the ejdst- 
ence of an appropriate recorded lec- 
ture may well be a future computer 
job. 

Research and Analt/sis 
Computers have of course been uti- 
lized for the statistical and/or mathe- 
matical analysis of research data for 
many years (8). Recently computer 
systems have made it possible to 
sist in learning clinical medicine by 
re-examining certain medical ^och- 
niques. For example, use of Slacks 
automated patient history taking s^- 
tem (9) permits the doctor for the 
first time to repeat the process of ob- 
taining a patient history. The same 
can be said of the interpretation of 
electrocardiograms by computer s\'s- 
tems (10). One probably cannot re- 
learn a fact or concept in quite the 
same way (with or without a comput- 
er). Even so the advent of "Computer 
Aided Instruction” systems should 
permit a far more eyeful study of 
learning processes in those who le^ 
through computer terminals than has 
ever been possible in the past. 



It is bey’ond the scope of this paper 
, review the numerous excellent ven- 
ires into true "computer diagnosis . 
refer to the work of Lustetl and 
cdley, Warner, Lodwick, Rcichirlz. 
nd Moore and others. In all c.iscs a 
omputer system is requiring certain 
bservations or measurements from 
,e phwicians before attempting to 
alculatc a diagnostic likclihootl. The 
ffcct on the user is to demand great- 
r precision and consistency’ than usu- 
I Often the program guides him bv 
Lsldng “the next logical question ^ 
"or example before the Li^wick and 
Icichcrtz program will yneld up an 
ipinion concerning the likclihor^ of 
mne tumor, it rerpiircs the resident 
jr fellow to make seventy observ^- 
ions and/or measurements on the 
roentgenograms or patient. Even af- 
ter the diagnosUc programs have 
evolved to the minimum number of 
true discriminating factors, it seems 
likely they svill still be able to ask for 

observations and measurements 
svill help the beginner learn 



ber it. 

There are innumerable examples of 
computer termin.als and apparatuses 
designed to give the research^ a new 
way to visualize his data. MiiUi-dimcn- 
sional plotting and display, symbolic 
representation of data, conversiitional 
mode of statistical analysis - all offer 
real potential for insightful analysis 
of medical data from groups of pa- 
tients. It remains for us to learn to 
use modem display devices so as to 
•'rive a new dimension” lo Ine data 
for the individual patient at the time 
of his illness. 
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SUMMARY 

CX)MPUTERS IN CLINICAL MEDICAL EDUCATION* 



Pand: Donald A. B. Lindbcrg, M.D., Chairman, Robert Cremrs, M.D., MitchcU Schormv, John 
A. StarIn\Tathcr, Ph.D., James S^^’ccncy, Pfi.D. 



Dr. Robert Greenes described the 
present computer system at the Massa* 
chusetts General Hospital which utilizes 
a conversational mode for the collection 
of information for the patient medical 
record. This system uses a branching re- 
sponse approach to keyboard entries on 
the part of the medical user. Both tele- 
type terminals and cathode ray tube ter- 
minals are employed. The latter include 
a special device produced at the Massa- 
chusetts General Hospital that consists 
of a number of fine parallel wires cross- 
ing the face of the cathode ray tube 
screen. When the medical user touches 
one of the wires to indicate his choice of 
a response displayed on the computer 
terminal, his body acts as capacitance to 
activate a circuit whereby the computer 
senses his choice. 

Dr. Greenes stressed both the need 
for relatively carefully formated entries 
in the patient record and the need for 
the medical user to enter free form re- 
sponses on the computer terminal. In 
some cases the standardized or formated 
responses are “fixed field” although this 
is not always necessary. Processing of 
the totally free form entiy is possible be- 
cause the conversational mMc has al- 
ready contributed a considerable strue- 
ture to the data. 

This system is being utilized in an ex- 
perimental mode on a regular basis for 
three patient record data collection com- 
pilations. These are the automated pa- 



tient history, the conversational mode 
system whereby the M. D. can answer 
the residts of his physical examination of 
the patient, and a system through which 
the radiologist is able to enter his 
impressions following interpretation of 
roentgenograms. 

Dr. Greenes, Dr. G. Octo Barnett, and 
their associates want to extend the ex- 
perimental system in order to investigate 
new applications and new areas in the 
hospital setting. Dr. Greenes stressed 
that one of the advantages of this type 
of system, especially in the example of 
the radiologv system, is the ability the 
system gives medical users to monitor 
tne thoroughness with which x-rays are 
examined. Tin’s can play a definite role 
in the edueational process of residents 
and young physicians studying radiolo- 



Dr. Greenes did not see any major 
(roblem in the existing hardware or 
omputer soft ware. The major problem 
it the moment is the extreme amount of 
ime involved for the radiologist to 
troduce a dictionary, branching code, 
astructions and the thesaurus capability 
equired by such a data collection .sys- 
cm. It is possible that a radiologist 
ould spend the better part of a full year 
a designing a system to handle only a 
(ortion (perhaps as .small as fifteen per 
ent) of the total dictionary and asso- 
iated .systems required for the field of 
liacnostic radiology. Consequently, the 



^Presented by Donald A. 8 . Lindberg, M, D,, Panel Chairman, al the closing plenary session of 
the conference. 
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limiting factor in this clinical data col- 
lection system is the amount of time 
possible for clinical physicians to con- 
tribute to building new portions of the 
system. 

Dr. James Sweeney described the his- 
tory of the Tulane information process- 
ing system as well as the present more 
advanced version known as GIPSY. He 
stressed the general problem of estimat- 
ing the true information content of data 
collected through computer systems. Dr. 
Sweeney’s system deals only with infor- 
mation which can be represented by al- 
phanumeric characters, and only infor- 
mation as it is perceived by the human 
“sensor.” The major objective for indi- 
viduals designing computer systems is 
not so much that the system need be a 
total and perfect reflection of the real 
data, but that it not lose any information 
which has been perceived by the human 
observer. The system then becomes a re- 
pository for the observations of the hu- 
msn being, and should provide him ca- 
paoility to inquire into this repository. 
In order for the systems to be at all 
manageable and realistic in a medical 
setting. Dr. Sweeney felt it essential to 
strip off from the total information of 
the hospital all that is not likely to have 
essential worth in patient treatment and 
medical teaching. Dr. Sweeney dis- 
dained the two extreme views: the view 
that all clinical information is exceeding- 
ly unreliable and “noisy” and the view 
that leads some people to wish to collect 
all information connected with patient 
care. Dr. Sweeney characterized the lat- 
ter approach as me "pack rat principle” 
and pointed out that one should have a 
fairly good idea of the use to which in- 
formation will be put before committing 
oneself to a computer data collection 
system. 

Dr. Sweeney stressed that the medical 
record has very many functions. It is 
not, in his opinion, well organized at 



present for purposes of sc 
quiry. He also raised th 
whether medical people b( 
trained in the normal course 
ucation for conducting scicn 
ies into information systen 
present paper medical rc( 
with computer repositories 
information. Dr. Sweeney fel 
new approaches and possibl 
mal education of medical 
might create a more usefid t 

At present. Dr. Sweenev 
ing the reprogramming of hi; 
formation processing system 
with the needs of I.B.M. 36C 
hardware. He expects to be ( 
a year and expects the syster 
erally usable by other invest! 
medical and general scie 
Sweeney’s advance planning 
scheme to provide on-line in 
vesUgators into their rcsearc 
using computer terminals. H 
collection will remain for t 
the paper form, utilizing cert 
coding” principles develope 
years oy nim and his gro'ip. 

Dr. Sweeney acknowledge 
enc^ of a problem in the exi 
facturer-supported progran 
guages. On the other hand, 
major problems to be still in 
definition by medical perso 
uses to which information ^ 
careful systems design, and t 
ty for innovative uses of com 
developed in the future. He 
the inquiry capability he pla 
op has the possibility to giv 
mension to the interphase 1 
human and the computer da 
had developed interactive ir 
bility into his system using 
eration hardware. Under t 
tions, the response time in 
was three to four minutes. I 
his new system can reduce I 



to four seconds, and that response times 
in the range of one second will probably 
be required in order to obtain optimal 
interaction between a research investi- 
gator and his data base. 

Mitchell Schorow described the work 
that Dr. George Miller and he arc doing 
in primarily addressing them.sclvcs to 
the problem of educating medical per- 
sonnel for clinical problem solving. The 
systems with which they arc working 
permit them to create within the com- 
puter system the patient history data 
base utilizing a single actual patient his- 
tory, a combination of actual patient his- 
tories, and where necessary, artificial 
constructs. The computer system per- 
mits the student to “treat” the patient by 
permitting him to ask the system for in- 
formation about the patient and his re- 
sponses utilizing virtually free form nat- 
ural language. For example, the system 
presents to the student the information 
that he has a “patient who is a forty- 
nine year old white male with low back 
pain of two years duration, of increasing 
severity for the past six months.” The 
student is then given the opportunity to 
make diagnostic investigations and 
treatment of the computer “patient.” 
The responses of the system are de- 
signed to contribute to the student’s 
gaining clinical acumen and good judg- 
ment. 

Mr. Schorow and Dr. Miller arc utiliz- 
ing I.B.M. 1500 computer hardware and 
writing in Coursewritcr II language. At 
present, they believe that their system is 
capable of giving totally appropriate re- 
sponses to the student’s free form ques- 
tions in about seventy per cent of the 
cases. This is in contrast to their belief 
that a minimum of ninety per cent ap- 
propriate responses are necessary in the 
long run for the system to be a complete 
success. In fact, their system is still in an 
experimental stage, although operating 
in a gratifying manner. 



Another major obstacle for these in- 
vestigators to overcome is the amount of 
author time required in order to create a 
good student teaching program. At pre.s- 
ent, about forty hours of author time arc 
required in order to produce one to two 
hours of student teaching material. 
Members of the panel were quick to 
note that even the forty hours represents 
a very considerable improvement over 
the amount of author time which was 
required by other computer-aided in- 
struction .systems. In many cases in the 
past, one hundred to Uvo nundred hours 
on the part of the author have been 
needed in other systems to create one 
hour of student teaching material. 

Respoase time of the present Schorow 
system averages from four to five sec- 
onds, with a maximum response time of 
thirteen seconds. Mr. Schorow felt that 
any response in excess of eight seconds 
in such a system was totally unsatisfac- 
tory, since the delay left the student in- 
tolerably impatient. His feeling is that 
within the next two years, the response 
times of their system will have been re- 
duced to acceptable levels. 

Mr. Schorow stressed the need to 
have built-in objective evaluation criter- 
ia in the development of all such sys- 
tems. He did not feel that his own sys- 
tem is sufficiently far advanced at pres- 
ent to report the complete evaluation at 
this time. His anecdotal experience with 
the system encouraged him to believe 
that the system was f{uite acceptable, in 
fact, exciting to medical student users. 
About one and one quarter hours are re- 
quired for each student to complete a 
single clinical medical problem. 

The problems presented to Mr. Scho- 
row in creating a system capable of ac- 
cepting totally free entries on the part of 
the student were described as serious 
ones. Ill order to accomplish this, the au- 
thors have utilized prepositional and 
propositional calculus, and other ad- 



vanced theoretical information handling 
technics within the programming sys- 
tem. He seemed to feel that these tech- 
nics will ultimately prove adequate to 
the problem. 

Dr. John A. Starkweather described 
his professional obligations at the Uni- 
versity of California. These include the 
duty to improve education for both the 
medical student and medical profession- 
al community as well as nursing stu- 
dents and personnel, and other medical 
and paramedical groups within the en- 
tire medical center complex. In order to 
accomplish the task, he described the di- 
vision of his central computing staff into 
groups concerned with education, re- 
search, and patient care, and operating 
as separate units. All three of these 
groups as well as the scientific users, 
utilize a single computer facility, in the 
form of an I.B.M. 360/50. As a conse- 
quence, Dr. Starkweather utilizes 
OS/360, operating in multiple fixed par- 
titions, including tele-processing parti- 
tions as well as batch-processing parti- 
tions. A second smaller computer 
(360/20) is included as part of the sys- 
tem. The interphase between the two 
systems being “HASP” input/output 
spooling routine. 

Dr. Starkweather stressed that it was 
possible to serve this diversity of com- 
puter users with existing technics. On 
the other hand, he emphasized his feel- 
ing that ideal and optimal application of 
a computer in medicine, especially com- 
puter-aided instruction systems, defi- 
nitely requires new programming lan- 
guages. These languages must inter- 
phase between the medical educator 
and the various rigorous and complex 
requirements of OS/360 and its Job 
Control Language. One such attempt in- 
volving Dr. Starkweather’s new pro- 
gramming language system PILOT was 
described. PILOT is itself written in 
PLI programming language. The intent 



of this system is to aid in teaching prob- 
lem solving to students and in teaching 
the method of inquiry into patient prob- 
lems to medical personnel. The ultimate 
aid of the PILOT system is to permit 
the medical educator to create his teach- 
ing routines with a minimal amount of 
programming knowledge, and to permit 
him to do some file handling through re- 
mote computer terminals when the sys- 
tem is finally completed. Dr. Stark- 
weather stressed his belief that the pres- 
ent tools for inquiring into computer 
systems, for teaching of problem solving, 
and for simulation as a means of com- 
puter-aided instruction are still extreme- 
ly primitive. 

Even so, computer systems have the 
potential for giving appropriate re- 
sponses to relatively free inquiries on 
the part of students. Dr. Starlaveathcr 
felt that at this very moment, the basic 
approach of branching conversational 
mode structured inquiry presented by 
Dr. Robert Greenes from the Massachu- 
setts General Hospital system probably 
is closer to being an operational reality 
than the free form entry systems. In es- 
sence, he believed that the matrix of 
questions and responses used at Massa- 
chusetts General Hospital is presently 
totally realistic, but that the system he 
himself is striving to create for handling 
free form inquiries offers a greater po- 
tential in the long run, and that this po- 
tential can ultimately be achieved. 

Dr. Starkweather stressed two addi- 
tional conclusions: one, that the facility 
of a large computer to store vast 
amounts of information, whether patient 
care information or didactic information, 
will in fact make a major contribution to 
medical teaching; two, the extreme im- 
portance in the Tong run of the comput- 
er’s ability to provide the knowledge of 
many medical authorities to help one 
single student. 

Dr. Starkweather presented in some 
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detail an application of his program- 
ming system in which a student can 
learn to conduct a psychiatric interview. 
A characteristic of this system is the 
ease with which the novice computer 
user can answer the system and begin 
his learning experience. Dr. Starkweath- 
er stressed, the fact that although tlic 
.system is obviously a simulation experi- 
ence, the individuals using it seem to en- 
ter very seriously into the simulation. 
For example, inaividual users seem to 
be compelled to quickly answer some 
sort of response to the computer termi- 
nal questions, even though they would 
prefer to think over the answer and even 
though the question may be an awk- 
ward one. In this respect, they seem to 
forget that the computer terminal itself 
is so utterly patient. 

At present. Dr. Starkweather’s major 
programming system is operating well 
within the medical center and has good 
language handling capability, although 
it has some temporary limitations on the 
number of terminal units it can serve. 
The language is designed to aid the user 
by offering conversational mode assist- 
ance to him while his programming ef- 
forts are being conducted. The system is 
based on a former similar system with 
which Dr. Starkweather had had experi- 
ence, namely Computest on the I.B.M. 
1620. 

The major problems Dr. Starkweather 
described involve very serious limita- 
tions in present manufacturer-supported 
programming language. He plans to cor- 
rect this problem by extending his own 
compiler/ interpreter programming sys- 
tem. He, the other members of the pan- 
el, and numerous members of the audi- 
ence were in agreement concerning this 
issue: they all stressed their desire for 
federal government and manufacturer 
support for the development of new lan- 
guages for medicine and specifically for 
medical education. Dr. Starkweather 



suggested four specifications for any 
such new language. 

1. The language should offer ease of 
entry to the computer novice. In connec- 
tion witli this, he stressed the extremely 
poor quality and total unreadability of 
existing manufactiu'er produced pro- 
gramming manuals. 

2. The language should offer ease of 
editing; that is, facility with which the 
author can make minor alterations in his 
text and instructions. 

3. The language should offer ease of 
translation from similar or more primi- 
tive programming languages. This is ex- 
tremely important so that instructional 
material can be exchanged between 
medical users in different institutions. 

4. The new language should offer the 
ability to print for the user his source 
level instructions utilizing more than 
one level of readability. This would 
mean that the individual relatively unfa- 
miliar with the program or even other 
programming languages could request a 
“print out of the program” in a relatively 
conversational, even verbose, form. On 
the other hand, the experienced individ- 
ual should be able to request a state- 
ment of tlie program in very much more 
terse, compact, and efficient style. 

A number of members of the audience 
expressed their agreement with the re- 
quirements Dr. Starkweather laid out as 
well as the general inadequacy of pres- 
ent programming languages. One mem- 
ber suggested that with respect to medi- 
cal education, we were at a point analo- 
gous to the days of scientific program- 
ming before the existence of FORTRAN 
and other appropriate scientific liigh 
level languages. 

There was considerable discussion at 
different portions in the afternoon meet- 
ing from the audience concerning the 
recurrent theme: why are there not 
more existing completed courses in med- 
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icine available through computer-aided 
instruction. All participants seemed in 
agreement: 

1. That there are no completed medical 

courses. 

2. That even the most promising provi- 

sional courses at the present will 
have to undergo extensive medical 
testing and evaluation. 

3. That an entire medical course,' at 

least in the traditional medical 
school sense, is unquestionably far 
too large a unit with which to be- 
gin attempting computer-aided in- 
struction. Many participants felt 
that a single one hour lecture 
might represent a realistic unit for 
the medical educator to approach 
with computer technics. Other par- 
ticipants, especially Dr. Greenes, 
preferred to approach a clinical 
problem rather than either a lec- 
ture or a course. The magnitude of 
the problem was hard to represent 
but he agreed that it might well be 
of the same order of magnitude as 
a single lecture. 

There was considerable discussion 
aimed at explaining the present essen- 
tially primitive state of computer-aided 
instruction in medicine. Many explana- 
tions were offered. A popular one 
seemed to be the belief that the prob- 
lems in medicine were essentially very 
much more complex than the problems 
presented in teaching undergraduate 
subjects of a seemingly more quantita- 
tive and more rote nature. Examples 
were offered: statistics, languages, 

grammar school spelling and arithmetic, 
and college physics. The latter example 
was challenged by one of the panel 
members who suggested that it had cost 
more than $200, to program one col- 
lege physics course, and that the final 
result had not been totally acceptable to 
the teaching department involved. Con- 
sequently, one was left with the feeling 



tliat the participants generally agreed 
computer-aided instruction could be 
utilizied in areas where the teaching 
unit was sufficiently small, and the 
material to be covered was sufficiently 
well defined; but that in fact, neither of 
these conditions had yet been identified 
in a truly medical setting. 

As an extension of the above, there 
was considerable discussion from both 
the audience and the panel concerning 
the question of new roles for computers 
in medical education. Virtually everyone 
was willing to concede that the use of 
computers to compile and give inquiry 
capability to the patient record keeping 
system probably provided a suitable as- 
set ill a medical education setting. There 
was, however, very little enthusiasm 
from the audience to pursue this prob- 
lem during the meeting. There seemed 
to be willingness to believe that this en- 
deavor was worthwhile, especially if the 
questions asked such a computer data 
base were aimed at an epidemiological 
or population level, and especially if 
epidemiologists were able to play a role 
in teaching students to ask such ques- 
tions. 

In a similar way, there was a great 
willingness on the part of the partici- 
pants to accept the contention that ov- 
ertly instructional, traditional 
computer-aided instruction technics 
could take their place in the long run as 
a valid portion of the medical education 
armamentorium. Even so, most people 
were willing to admit that accomplish- 
ments in this sphere were presently 
quite limited and the technics essentially 
still primitive. For this reason, there was 
a very general consensus that the profes- 
sion should continue vigorously to seek 
new iiriaginative applications for com- 
puters in teaching. This might take the 
ultimate form of diagnostic games, com- 
puters as an aid in logic and reasoning, 
computer simulation of mental and/or 
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physical processes or as yet totally un- 
discovered applications. In order to pur- 
sue this course of action, it was agreed 
that one should make every attempt to 
include objective evaluation eritcria into 
such experiments. It was the belief of 
the section chairman, to which he gar- 
nered surprisingly little support, that the 
proper application of cost effectiveness 
criteria cannot be made to the e.xperi- 
inental systems unless one earefully 
specifies the states of development 
through which such systems need to 
pass. In this sense, he was urging the 
application of staged development tech- 
nics utilized in engineering; for example, 
creation of .specilications and require- 
ments, pilot model, prototype model, 
test model, production model, and final 
evaluation. In defense of this contention, 
it should be noted that there was only 
one engineer in this section meeting. He 
was an industrial engineer and con- 
curred with the desirability of staging 
e.xperiments. - 

A member of the audience asked the 
group for general recommendations for 
a university administrator in planning 
for computer terminal capability in the 
design of a new campus structure. The 
consensus was that: 

1. The school should make provision for 
ossible coaxial cable connections 
etween the new building and the 
campus computer site (probably 



this would mean a tunnel). 

2. With the new building, suitable tele- 

phone line conduit should be pro- 
vided to each office and laboratory. 

3. False or “deaf ” ceilings should be 

used. 

4. Air conditioning should be provided. 

5. No cables or electrical connections 

.should be buried in concrete, nor 
should “channels’” in concrete be 
used. 

These were general recommendations. 
The group agreed that provision might 
be made for a small peripheral comput- 
er in the new building if a large number 
(more than eight or hvelvc) computer 
terminals were planned. A small com- 
puter would also probably he needed 
within the building if complex physio- 
logical simulations were planned (such 
as the automated anesthesia dummy de- 
scribed by Dr. Abrahamson). 

Inquiry was made of the group for a 
published estimate of national, state, or 
regional manpower needs with respect 
to medical computer personnel. Primari- 
ly the question here was the need for 
development of medically oriented com- 
puter systems and operators, computer 
programmers, and information scientists. 
All those asked felt most such persons 
were in critically short supply but could 
neither document this need nor identify 
institutions at which, such persons are 
being trained. 



In summary, the participants were enthusiastic about the potential of contri- 
butions of computers to medical education. They seemed to feel generally that 
this field is presently in its infancy; that it should be explored in an openly e.xpcr- 
imental framework. A major limitation to progress in the field at present is the 
exhorbitant amount of author/ clinician time required for the creation of even ex- 
perimental systems. The participants seemed to feel that this problem was best 
attacked by the creation of new computer programming languages, pre-lan- 
guages and/or systems, of a sort to support conversational mode interaction be- 
tween the relatively inexperienced user of computers and the necessarily large 
and complex computing systems which will be required. 
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I will begin with a disclaimer. My 
knowledge of computers is best de- 
scribed as rudimentary, and if I speak 
with any semblance of confidence about 
bits and core, of CRT and 360-50, it is 
because my associates have pro- 
grammed me with some care to respond 
appropriately to natural language input. 
Having made such a confession I must 
also acknowledge that my justification 
for accepting an invitation to appear on 
this program is based upon a conclusion 
that the key word in context of the 
conference title is not computers but ed- 
ucation, a field in which I feel some- 
what more comfortable. 

For in fact, the computer is neither 
more nor less than a tool, neither laud- 
able nor objectionable except in terms of 
the task it is to perform. And when that 
task is continuing education then the 
problem is formidable, for debates 
about the perplexing and frustrating is- 
sues in this field grow ever more shrill. 
Of only one thing do we seem certain: 
the pressure is mounting for the univer- 
sities and others to do something, prefer- 
ably something new and hopefully with 
new tools as well. Among the new tools 
to which we are turning, the computer is 
nearing the crest of a wave of enthu- 
siasm that was only recently vacated by 
programmed instruction. Discussion of 
computer assisted instruction is becom- 
ing a babel in the land, and talk of net- 
works and compatibilities and sofhvare 



can be heard almost everywhere. But in 
the language of communication theorists 
the educator must ask whether all this 
sound represents a message — or merely 
noise. 

I am personally inclined toward the 
view that there is not only an important 
but a critical message to be heard, but 
one cannot deny that the noisemakers 
are also plentiful among us. These are 
the ones who seem to be saying that this 
dazzling new medium is the message — 
and like the medical educators before 
them who made the same claims about 
films and television and programmed in- 
struction they divert us from the central 
question of educational purpose to be 
served by such exciting tools. 

This cautionary comment must have a 
familiar ring, but it is now touched with 
a note of urgency. For the widespread 
restlessness about improving means of 
bringing an ever growing body of medi- 
cal information more rapidly to practi- 
tioners is accompanied by a mounting 
faith that the incredible information 
storage and retrieval capacity of the 
computer can accomplish this allegedly 
critical task. While it would be foolhar- 
dy to deny the accelerating pace of 
knowledge growth, it is at least defensi- 
ble to raise the question of whether the 
problem of continuing education is less- 
ened or magnified when a practitioner 
seeking information gets a MEDLARS 
printout of eighty citations on the topic 
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about which he has inquired. The tech- 
nical achievement of such a production is 
staggering, but the educational impact 
may leave more than a little to be de- 
sired. 

The educational issue then is not com- 
puter capacity and versatility, but rather 
what kind of information shall be stored, 
in what manner it should be processed 
and retrieved, in order to serve what ed- 
ucational objectives. In my own trou- 
bled search for an answer to this ques- 
tion I have come, on April 4, 1968, to a 
point of identifying four functions to 
which the computer seems both ready 
and able to make a contribution to con- 
tinuing medical education. I share them 
with you not in any confidence that they 
will survive your scrutiny, but in the 
hope that they may serve as organizers 
for our discussions this afternoon. 

The first, to which I have already re- 
ferred in passing and which will be 
more fully developed by Dr. Cummings, 
is the library function. I find it difficult 
to believe, as some seem to imply, that 
the library of the future will be a collec- 
tion of discs and tapes and punch cards 
from which words will flow as a steady 
electronic stream in response to the 
command of a discriminating client. But 
the evidence is persuasive that there are 
more efficient means of searching for an 
informational bit than poring through 
a card catalogue or the Index Medicus. 
The computerized search function, with 
retrieval of selected abstracts or rapid 
reproduction of full texts will surely be 
an important contribution to the physi- 
cian who has a specific question for 
which a specific and documented ari- 
swer is available. Aside from the techni- 
cal problem this poses, there is an edu- 
cational problem of retrieval, of match- 
ing level of inquiry with level of re- 
sponse, and not overwhelming the in- 
(^ircr with more information about pen- 
guins than he cares to have. I suspect 



that this library function will be of 
greater significance in the continuing 
education of academicians (who seem 
to have a high level of tolerance for ir- 
relevant information) than for practi- 
tioners — but that is a matter of specula- 
tion. 

The fact remains, however, that this 
function will be useful in fulfillment of 
only one objective of continuing educa- 
tion, and one which at least some of us 
believe to be of secondary rather than 
primary importance: that of providing 
information. It does not guide learning, 
but responds to practitioner-generated 
inquiry which can as easily be a major 
effort to find small things as essential 
study of critical matters. Such random 
activity must sometimes be best de- 
scribed by Dorothy Parker’s phrase, 
“There is less here than meets the eye.” 

Secondly the computer can serve a 
consultative function. It has been said 
by some, although without benefit of 
any discernible evidence, that the best 
continuing medical education occurs 
when a consultant and practitioner work 
together in solving a perplexing clinical 
problem. To the extent that this is true, 
the role of the consultant-teacher would 
appear to be primarily that of bringing a 
special body of information, or a partic- 
ular skill in applying both familiar and 
new knowledge, to the problem at hand. 
It is such a function that seems to be 
served by some of the imaginative com- 
puter applications that have already 
been introduced into clinical practice in 
some parts of the country. For example, 
the computer analysis of electro-cardio- 
grams which not only frees a physician- 
interpreter from routine tasks but also 
focuses his attention upon elements of 
the tracing that require special consider- 
ation; the clinical diagnostic system 
which guides a practitioner’s inquiry 
and from a vast memory core can sug- 
gest diagnostic probabilities, as well as 
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possibilities that have escaped his atten- 
tion; the rapid calculation of radiothera- 
peutic dosage which incorporates con- 
sideration of many variables that might 
othenvise have been neglected or omit- 
ted; the continuous monitoring and syn- 
thesis of physiologic data from patients 
in coronary care units, patients whose 
course may be modified by early recog- 
nition of impending complications; the 
rapid analysis and weighting of histori- 
cal items in screening examinations, 
with probability projections that allow a 
practitioner to focus his attention upon 
the most significant matters in his en- 
counter with an individual patient. All 
of these may provide substantial and 
significant assistance to a physician in 
the fulfillment of his professional role, 
and thus contribute to solution of the 
critical manpower shortage which besets 
us. But the question that must occupy 
our attention here is whether these 
things, or indeed whether more conven- 
tional consultative exchanges, are educa- 
tional in the sense that they extend the 
learner’s ability to deal more efficiently 
or more effectively with comparable 
problems he encounters in the future, or 
in another setting. It is surely possible 
that they may do so, and I am prepared 
to accept this as a potential, if not a de- 
monstrably achieved outcome. But at 
the same time it seems important to note 
that a crutch may lead to dv^pendence as 
well as to independence. Nor does the 
use of a more efficient kind of crutch 
necessarily influence the nature of the 
outcome. There would probably be no 
dispute with the view that electronic 
measurement of the hemoglobin level is 
more precise than the Tahlquist method, 
but there might be considerable ques- 
tion whether the introduction of accura- 
cy has led practitioners to more rational 
practices in the treatment of anemia. 

If the consultation function is to be 
useful as an educational instrument it 



must probably be accompanied by some 
systematic review of what has been 
learned, not merely what diagnostic or 
therapeutic goals have been achieved. 

Third is the tutorial function, perhaps 
the most familiar of the species included 
under the genus computer assisted in- 
struction. It is this form that many vi- 
sionary directors of continuing educa- 
tion programs have in mind as they pic- 
ture a computer network for a city, a re- 
gion, a state, or in the case of EDU- 
COM, a nation. Such a mode lends itself 
to discrete course packaging, and to sys- 
tematic consideration of highly impor- 
tant clinical content and concepts. With 
the complex branching capabilities 
which even a simple computer offers, 
the instruction may proceed not only at 
an individual learner’s pace, but may 
bypass infoimational bits with which he 
is already familiar. Unlike the book, 
which also offers these advantages over 
classroom instruction, the tutorial form 
of computer instruction forces active 
participation in the learning process and 
some assurance that the necessary con- 
tent has been mastered to a predeter- 
mined level before proceeding to the 
next stage. And the recitation, which 
most such programs require, has the ad- 
vantage of being personal and private so 
that the revelation of ignorance carries 
no social threat, unless the learner per- 
sonalizes the computer-tutor and tries to 
beat the transistors in much the same 
fasb’on that students have for so many 
years tried to beat the living teacher. 

Recognizing these several advantages, 
which reflect the incorporation into edu- 
cational technology of substantiated 
theoretical concepts of learning, there 
are still many who cry out in despair 
that such mechanical and dispassionate 
instruction might displace the warm and 
personal interaction between live teach- 
er and live student. I suspect that most 
such complaints come from teachers pic- 
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turing what they think they do with s^- 
dents rather than from any accurate de- 
piction of what occurs in lectures, 
conferences, even seminars, in hundreds 
of continuing education programs all 
over the nation. Is listening with one 
hundred odiers to an expert talk (with 
the opportunity to ask questions at the 
end of the hour — if there is time left) 
really personal instruction, while engag- 
ing in active individual analysis, in- 
teroretation and discussion of informa- 
tion with a carefully programrned com- 
puter really impersonal? And for those 
who insist that such an exchange is mere 
training, not real teaching, I would note 
the comment by B. F. Skinner in a re- 
cent Science paper that when we know 
what we are doing it is called training, 
and when we don’t it is called teaching. 

Despite the advantages of planned 
coverage, carefully specified learning 
objectives, active learner participation 
and immediate feedback, the tutoria 
mode of computer assisted instruction is 
still focused upon information which has 
been selected and processed by a teach- 
er, and whose acquisition is assumed to 
be accompanied by transfer into profes- 
sional practice. It is this assumptiori that 
must be most seriously questioned, for 
practitioners have long known, for ex- 
ample, that bacteriologic identification 
of an organism should precede institu- 
tion of antibiotic therapy or at the very 
least, confirm the choice after the fact, 
but even casual inspection of the reality 
reveals the frequency with which this 
lot^ical pattern is ignored. Such discrep- 
ancy between knowing and doing is the 
most disquieting problem of all for 
thoughtful leaders in continuing educa- 
tion. 

It is for this reason that I am particu- 
larly attracted to the fourth educational 
function the computer may play - the 
simulation function. In order to avoid 
any potential argument let it' be openly 



acknowledged at once that simulation is 
not reality. But at the same time let the 
claim be underscored that for some in- 
struction it may be more useful than 
reality. For in simulation it is possible to 
extract a critical and planned segment of 
an often complex and unpredictable 
world; to control the evolution or se- 
quence of important variables; to pro- 
vide learners with opportunity for inde- 
pendent action without doing harm to 
either subject or object; and through 
this dynamic mechanism to provide 
immediate feedback of consequences of 
an intervention, not merely information 
about what might transpire. It is an in- 
structional form that focuses upon use 
rather than mere possession of knowl- 
edge. 

There are already exciting develop- 
ments in computer simulation, rariging 
from relatively simple to dismayingly 
complex. Spivack’s arrhythmia trainer, 
one of the simpler applications, creates a 
situation in which sudden changes in 
electrocardiographic pattern displayed 
on an oscilloscope demand prompt and 
proper application of electrical stimuli 
to a synthetic torso in order to reverse, 
for example, ventricular fibrillation or to 
initiate appropriate pacing of a poten- 
tially disastrous heart block. A more 
complex mode is Sim I, Stephen Abra- 
hamsons’ life-size dummy whose respira- 
tory activity, pulse rate, blood pressure, 
skin color and pupillary size, among oth- 
er things, are under computer control 
and respond to drug administration as 
well as to other interventions used by 
the anesthesiologist in managing pa- 
tients at surgery. Using this model, a 
trainee can be faced with a variety of 
situations he will shortly encounter in 
the operating room, and allowed to deal 
with them repeatedly, without risk to 
real patients, and with immediate feed- 
back about the effect of his judgments 
and hLs actions. 
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Another program is John Starkweath- 
er’s simulation of the clinical interview 
in which a student may play either the 
role of physician or of patient, while the 
computer carries out tne other part of 
the ialogue. 

The method with which I am most fa- 
miliar, however, is that under develop- 
ment in our own unit imder the direc- 
tion of Mitchell Schorow. This has 
grown out of the printed patient man- 
agement problem, the erasure examina- 
tion which has become one of the more 
familiar simulation methods in current 
medical education. Here the learner is 
provided with the bare bones of a prob- 
lem — usually little more than the pa- 
tient’s presenting complaints. Selection 
of general problem-solving strategies 
and specific management tactics must 
then be independently generated using 
natural language input, and with re- 
sponses provided through typed output, 
visual display ( such as x-ray, electrocar- 
diogram, biopsy specimen), or sound 
( such as heart soimds, limg sounds, and 
segments of spoken historical informa- 
tion that provide non-verbal as well as 
verbal cues). Management interventions 
are followed by alteration in clinical 
course, such that a learner may deal suc- 
cessfully with a problem, inadvertently 
induce complications with which he 
must then deal, or lose the patient to an- 
other physician — or to the pathologist. 
But Lazarus-like, this patient can rise 
from the dead, and if necessary suffer 
the same fate again and again. 

While such an encounter is demon- 
strably exciting, we must certainly avoid 
the comfortable trap of equating excite- 
ment with learning. They may be asso- 
ciated, but it is not necessarily so. The 
carefully created simulation, however, 
does provide an unusual opportunity to 
determine the means by which a learner 
attacks a problem, the types of evidence 
he accumulates before tal^g action, the 



relative weight he assigns to evidence of 
different kinds, the extent to which ef- 
fects of early interventions influence his 
subsequent actions, and his manner of 
dealing with deviations from anticipated 
outcomes. If the sampling of tliis behav- 
ior is sufficiently large it may even allow 
some generalization about his character- 
istic pattern of performance wliich, 
when cast against tlie judgments of a 
criterion group, can focus attention 
sharply upon tlie strengths and weak- 
nesses of his knowledge and his methods 
of utilizing knowledge. In short, it pro- 
vides diagnostic data which may then be 
used to prescribe educational therapy 
specifically selected to correct his per- 
formance deficits — therapy that may be 
in the form of books, journal articles, 
courses or tutoring. 

It is such a posture that has been as- 
sumed by the EDUCOM Task Force on 
Continuing Education — that education- 
al therapy abonnds, but diagnosis of 
need is in very short supply. With the 
Educational Testing Service and re- 
search groups in medicine, engineering 
and education a proposal has been de- 
veloped to study use of the computer, 
among other methods, for the purpose 
of developing such educational diagno- 
sis, and not merely the shotgun therapy 
which seems to characterize so much of 
continuing education. It is the hope of 
this study that a library of simulations 
designed to provide the basis for diag- 
nosis will not only direct attention to in- 
dividual and group needs but will also 
heighten the awareness that learning be- 
gins with recognizing a question, not 
having an answer, with the process of 
seeking and not alone with some prod- 
uct that others have found. 

Such a shift in educational strategy 
will not be easy to achieve, for teachers 
have long managed to divert a variety of 
instructional methods to their own 
needs. There is no reason to believe that 



a computer will accomplish a magical 
transformation of teacher-centered in- 
struction to student-centered learning. 
But it docs create an opportunity for in- 
dividualization of learning that one can 
hope will be grasped and exploited to 
the full. 

The developmental stage of any new 
method is certainly not the time to raise 
questions about cost, yet it is an issue 
that must ultimately be faced both real- 
istically and quantitatively. The current 
enchantment with computers will not 
last forever, and when the enormous 
bills for programmers and analysts, long 
lines and equipment begin to seem bur- 
densome, we had better be prepared to 
defend with something more solid than 
enthusiasm our view that computer-aided 
learning for practicing professionals is 
not only effective but competitive. As 



the investment in hardware and soft- 
ware goes steadily upward, I would 
plead for the diversion of some signifi- 
cant segment of that investment, in ev- 
ery developmental program, to system- 
atic study of use (once the bloom of 
novelty has faded), of cost (once the 
developmental price has been paid), but 
most importantly of effectiveness. And it 
is here that we will require a measure of 
humility that has not always character- 
ized the physicians who conceive pro- 
grams of continuing education, or the 
media masters who have noiurishcd ^d 
supported them. Our greatest need is a 
spirit of inquiry - not about computers 
(in continuing education), but about 
continuing education (vdth computers). 

And oh that shrill note I shall retire to 
the wings. 
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The panel and audience were charged 
by its chairman with development of 
discussion and recommendations which 
could guide those interested in working 
with computers in Continuing Medical 
Education and those who may have re- 
sponsibility for funding such work. 
Members of the audience introduced 
themselves and their major interests and 
questions. It was found that although 
the audience consisted of a diversity of 
backgrounds and interests, their ques- 
tions were very similar. The audience 
was actively involved in the discussion 
and this report includes their conhibu- 
tions as well as those of the panelists. 

The first major consideration was the 
relationship of computer based instruc- 
tional systems to other computer based 
health care systems. Dr. William Bles- 
sum of the California College of Medi- 
cine pointed out that he had been active 
in attempting to stimulate interest in 
computer based systems by pilot appli- 
cations for medical students. The com- 
puter group has been active for about 
nine months and there is interest in de- 
velopment of a system which utilizes 
computer-assisted instruction to the 
maximum extent possible. At the present 
time it is difficult to decide on which in- 
structional system to use since a number 
of significant ones are available. Fur- 
thermore, there are a wide variety of 
terminals and philosophies of design for 
the operating system in which comput- 



er-assisted instruction takes place. It is a 
continuing problem to determine how 
best to take advantage of the various 
programs available because of the wide 
variety of hardware configurations. Dr. 
Blessum challenged those engaged in 
computer-assisted instruction to realize 
that it is in an embryonic state of devel- 
opment and must be approached in an 
investigative atmosphere. He empha- 
sized the need to be as compatible as 
ossible and yet to realize that there is a 
anger in being compatible too early 
since this may restrict innovative ap- 
proaches. Therefore, he emphasized the 
need for generation of a master plan for 
all applications of computers in medi- 
cine so that library systems, medical in- 
formation systems, computer-aided in- 
struction, etc. will all be components of 
the same general system. The advan- 
tages and disadvantages of such an ap- 
proach were discussed. Specifically, it 
was pointed out that building a comput- 
er based instructional system as a part 
of a total health information system 
could provide a means for stimulating 
physicians to accept the computer as an 
instructional tool and to use it. The prin- 
cipal problem to be faced by developers 
of computer-aided instruction is how to 
get this form of instruction to physi- 
cians. Should terminals be put in doc- 
tors offices or can they take advantage 
of this through other means? It was felt 
that if computer-aided instruction were 
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part of a total health information sys- 
tem, one could more readily justify pro- 
viding terminals for physician’s use since 
it would be possible to have at his dis- 
posal many functions, such as summa- 
ries of clinical data, diagnostic assistance, 
information retrieval, etc. that would be 
of value to him. Furthermore, this would 
provide a means for obtaining feedback 
from the physician so that he could help 
define and contribute to the objectives 
of his own continuing education for 
translation by educators and computer 
scientists. The question as to whetlier 
physicians would use terminals for any 
purpose was discussed. It was alleged 
that medical students do accept them 
and if a computer based health informa- 
clon system were able to play a consulta- 
tive role and lead to improved patient 
care, physicians would make use of it. 
However, much discussion centered 
around the physicians acceptance of the 
computer especially as a part of his con- 
tinuing education. In summary, there is 
virtually no information available as to 
physician acceptance and careful study 
is needed. A computer based health cai’e 
system could provide high quality care 
of patients since it would have the ad- 
vantage of having necessary data avail- 
able and the results of group experi- 
ences to assist in judgments. However, 
in the development of such a system 
there is the need to separate judgments 
from facts and to provide for group 
rather than individual judgments. 

Another advantage to introducing 
CAI by this means is that it would have 
the virtue of peer group pressure on the 
physician to take advantage of a very 
potent tool. However, physicians will 
make use of it only if the computer 
based system improves the quality of 
their activities and if the system is well 
designed and meets their needs. All of 
this discussion was based upon accept- 
ance of the concept that the purpose of 



continuing medical education is to im- 
prove the quality of patient care. The 
group was also reminded that knowl- 
edge of what constitutes good care and 
use of such knowledge are not necessari- 
ly the same. 

The disadvantages of building the 
CAI system as a part of a health infor- 
mation system were also discussed. In 
the first place, such a system may be- 
come a “crutch” for the physician and 
thereby, defeat thinking and learning. 
Furthermore, if the system provides for 
punitive action or enforcement of partic- 
ular ideas, this may in itself defeat its 
acceptance and lead to the development 
of poor attitudes towards its use. How- 
ever, such a system permits continuing 
education to be indirect and thereby not 
require the physician to spend blocks of 
time in his education and this is desira- 
ble. Furthermore, the material presented 
will be relevant to the physician’s activi- 
ties and this has the greatest chance of 
inducing behavioral changes. 

The ■ discussion then turned to consid- 
eration of the objectives of a computer 
based continuing education program. 
Quality patient care was corisidered to 
be the most important objective of con- 
tinuing iDcdical education, but relatively 
little is known about what motivates 
physicians to obtain further education. 
Studies should be carefully and system- 
atically designed to determine what the 
objectives of continuing education 
should be. A very important point was 
made that getting information to physi- 
cians was not as important as inducing 
them to make use of this information. 
The material presented should be rele- 
vant to his own goals and therefore it is 
necessary to determine what these goals 
are and to translate them into meaningful 
educational strategies. The evaluation of 
any instructional system must depend 
upon the realization of goals and there- 



fore it is necessar)' to set objectives in 
advance. 

Other questions that need careful and 
systematic .study were also discussed. 
For example, does a computer based in- 
structional system actually inhibit learn- 
ing or perhaps better stated, under what 
conditions does such a system inhibit 
learning? If, for example, it were used 
by the physician as a decision making 
tool, it might influence the physician to 
not continue his education. Further- 
more, its use as a policing device would 
lead to rejection rather than stimulation. 

Is it better to introduce computer 
based instruction into medical schools 
and then continue with these students 
than to try to expose physicians who 
have developed study h^its over years 
of training? The general problem of in- 
fluencing medical students and physi- 
cians to change their habits of study is 
faced by educators interested in CAI 
since it will not be used if it does not 
prove to be a more efficient and success- 
ful method. CAI does have the virtue 
potentially of providing individually 
based instruction and thereby of being 
an effective self study tool. However, 
the realization of this depends upon ac- 
cess to medical information on a very 
side scale, hence, the apparent desirabil- 
ity of making it a part of a larger infor- 
mation system. 

Discussion then turned to the role of 
computers in continuing medical educa- 
Hon. The tutorial approach may not be 
indicated in conHnuing medical educa- 
tion due to the potenHal lack of rele- 
vance to the physician s concern. Again, 
it was emphasized that the immediate 
problem is not one of getting informa- 
tion to the physicians, but of sHmulating 
behavioral changes based upon that in- 
formaHon. The tutorial approach is most 
effective in the presentaHon of factual 
informaHon to be learned and hence by 



its very natiu-e is fairly rigid in design. 
Flexibility to permit the student to se- 
lect the material or portion thereof that 
he is to learn is very desirable. More so- 
histicated diagnosHc methods to assist 
im in this selection would be of benefit 
but at this time such metliods have not 
been developed. Computer simulaHon of 
clinical situaHons that are revelant is one 
approach to get the physician involved 
and to make it important to his own 
pracHce. Such situations permit the phy- 
sician to develop a solution with the as- 
sistance of the computer as a tutor. Ex- 
periments involving simulaHon of clini- 
cal situations are undei^vay, hence, more 
informaHon about this aspect will be 
forthcoming. Again, the consultaHve 
role of providing informaHon and assist- 
ance in decision making by means of 
tie-up with a health informaHon system 
was also pointed out. This provides the 
physician with access to empirical as 
well as theoretical information and ex- 
periences. 

The consensus of the panel was that 
the goals of continuing medical educa- 
tion are to develop a set of attitudes to- 
wards: (a) use of records in the broad 
.sense as a basis for judgments; and (b) 
appropriate medical care. 

Therefore, it is recommended that 
there be developed carefully and sys- 
tematically planned investigaHons into: 

(a) what should be the specific objec- 
tives of continuing medical education; 

(b) will inshniction developed from a 
computer based health informaHon sys- 
tem enhance or inhibit learning; (c) 
how will physicians use such systems; 
(d) will such systems lead to increased 
motivation for further education; (e) 
how does one develop compatibility of 
existing systems; and (f) what are the 
potential uses of computer-aided in- 
struction in continuing medical educa- 
tion? It was stressed that work to devel- 



op a greater diversity of computer based 
instruction must continue and be evalu- 
ated before the role of the computer in 
continuing medical education can be de- 



fined. However, such development 
should not ignore, but should attempt to 
gather information to answer the above 
questions. 
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AUTOMATION IN MEDICAL LIBRARIES* 

MARTIN M. CUMMINGS, M.D.f AND RALPH A. SIMMONSt 

In science, read, by preference, tlic newest work; in literature, the oldest. 
Edward BiJwcr-Lj^ton — Hints on Mental Culture. 



THE CHALLENGE 

An important purpose of medical edu- 
cation is the transfer of skills, knowl- 
edge, and information from a variety of 
sources through a variety of media to 
the student and practitioner. A most im- 
portant re.source in this process is the 
medical library. We liave become in- 
creasingly conscious of the relative roles 
of other media so important in the com- 
munication processes, including the in- 
formation transfer that takes place 
through personal discussions with col- 
leagues, attendance at professional lec- 
tures, and the use of the newer audio 
and audio-visual materials including 
television. But the literature — the writ- 
ten word — remains as a principal vehi- 
cle through which scientific concepts, 
facts, ideas and observations are trans- 
ferred. 

The growth of the medical literature 
has almost doubled over the past dec- 
ade, as has been true in practically all 
scientific fields. The literature itself 
abounds with articles discussing the ex- 
ponential rate of growth of scientific 
periodicals and writings. The order of 
magnitude of this “explo.sion” has been 
frequently debated with estimates of 
scientific periodicals being published to- 
day ranging from 35,000 to over 100,000. 



It has been estimated that there ai'e 
more than 18,000 serial publications in 
the biomedical field alone, with an 
equal number of medical books and 
monographs generated throughout the 
world annually. The growth rate has 
been described by Derek de Solla Price 
of Yale University. “The most remark- 
able conclusion obtained from the data 
. . . is that the number of journals has 
grown exponentially rather than linear- 
ly. Instead of there being just so many 
new periodicals per year, the number 
has doubled every so many years. The 
constant involved is actually about fif- , 
teen years for a doubling ...” (1) 
Vannevar Bush wrote as early as July 
1945 . . . "There is a growing mountain 
of research. But there is increased evi- 
dence that we are being bogged down 
today as specialization extends. The in- 
vestigator is staggered by the findings 
and conclusions of thousands of other 
workers — conclusions which he cannot 
find time to grasp, much less remember, 
as they appear.” (2) 

Our society looks to the university as 
the instrument of primary responsibility 
for the creation of knowledge through 
research, its dissemination through 
teaching and its application through 
service. The centers for education in the 
health professions have been developed 



•This paper was prepared by Dr. Cummings and Mr. Simmons as an extension of tlie subject, 
"Computers in Meuicnl Libraries,” presented by Dr. Cummings at the conference. 
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Library of Medicine. 



74 




/ O 



within this university framework to ac- 
complish this task with respect to 
knowledge in health-related matters. So- 
ciety originally looked to the libraries as 
instruments to preserve recorded knowl- 
edge at a time when the corpus was 
small and manageable. Today they have 
taken as an equally important function 
the organization and retrieval of needed 
information from the present enormous 
body of knowledge. Thus the library 
represents a central learning resource 

serving our universities. 

Health science libraries are faced with 
an ever increasing challenge. This is not 
due solely to the rapid growth in the 
medical and related literature; the wid- 
ening range of users and their accompa- 
nying diversity of requirements com- 
pound the problem. The list of users 
may include undergraduate students, 
graduate students, postdoctoral fellows, 
interns and residents, members of the 
teaching faculty in the basic sciences, 
clinical faculty members, practitioners 
in the health center or its environs, med- 
ical researchers, dentists, veterinarians, 
pharmacists, nurses, and other allied 
health personnel. It may also include 
other regional and hospital clients, 
health departments, welfare agencies, 
local industries, the county medical so- 
ciety, miscellaneous lay persons, attor- 
neys and others. The basic homogeneity 
of the principal users of a medical li- 
brary remains as an asset to the medical 
librarian in providing required services 
but as this list suggests, that advantage 
is no longer so pronounced. The impor- 
tance of interdisciplinary application of 
knowledge and research will continue to 
require expanding services and capabili- 
ties of the medical library. 

In addition to the quantitative 
changes of information and users facing 
the medical libraries, there have been 
important qualitative changes in medi- 
cal education. Curricula have broadened 



in scope and depth. New subject areas 
have Deen incorporated as Imowledge 
increases. Under^aduates are more in- 
volved in research. The student must 
absorb more of the total body of science 
and then be responsible for keeping up 
with new knowledge. It is no longer the 
medical undergraduate alone who must 
be educated, but the practicing physi- 
cian. B. V. Dryer in the article “Lifetime 
Learning for Physicians” has stated that 
. . . “The gap between scientific knowl- 
edge and application grows wider each 
year because of at least four reasons: 
the rapid advances of research; the mal- 
distribution of opportunities for contin- 
uing medical education; educational in- 
adequacies even in those places where 
opportunities do exist; and patterns of 
educational organization and dissemina- 
tion of knowledge which are not effi- 
cient in terms of the physicians students’ 
needs.” (3) 

The opportunity to prepare students 
with the needed attitudes to meet the 
later demands of continuing education 
must not be lost. The things which 
young medical students learn in their 
formal educational courses set the direc- 
tion of their future lives as physicians 
and scientists. Harvey Cushing, who on 
many occasions pointed out the impor- 
tance of the medical library for support 
of medical educaticn, research and prac- 
tice, commented on the importance of 
teaching students the value of their li- 
brary as follows: “To inoculate a doctor 
with the library-habit he must be caught 
young and here, as I see it, you have an 
excellent opportunity in being nearer to 
a growing centre of medical education. 

“If you are to infect the young with 
the reading habit, you must set the trap 
for them, so baited that they will walk 
into it unawares, Books must be made 
accessible. It is someone’s business in 
every medical school to teach laboratory 
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methods to the students but it is no 
one’s particular business to teach them 
how to use medical literature. . . (4) 

The subject of the need for continuing 
education should not be left without 
some reference to the place the hospital 
is assuming and the role of its library in 
this process. The hospital represents the 
location where the professional health 
personnel can bring scientific knowl- 
edge to bear on a problem. Within the 
last four decades, additional educational 
programs have been started within the 
hospital as it represents an unique envi- 
ronment where certain kinds of post- 
graduate education can take place. It is 
clear that the hospital must take increas- 
ing responsibility for education at all 
levels. When the hospital is thus viewed 
as a scholarly institution involved in re- 
search and education as well as patient 
care, tlie need for effective access to 
medical and related scientific knowl- 
edge is self-evident. The dilemma is that 
the requirement for the availability of 
the scholarly record is so broad that no 
single hospital library has the resources 
to properly respond. 

The problems of scientific communi- 
cation confronting medical librarians ap- 
pear to approach the insurmountable; 
quantity of information rapidly growing, 
quality of education and research im- 
proving, information user groups ex- 
panding, interdisciplinary requirements 
enlarging, and education throughout a 

f irofesslonal’s career demanding support, 
t seems likely that the health sciences 
libraries will have to take on a new iden- 
tity and function to meet this challenge. 

Libraries are even now rapidly turn- 
ing to the electronic technology to re- 
spond to society’s demands. 'The use of 
advanced data processing equipment, 
including computers, coupled with the 
research and techniques aeveloped and 
being extended in the emerging field of 
information sciences holds great promise 



for the solution of the biomedical com- 
munications dilemma. There is a warn- 
ing, however, that must be sounded be- 
fore exploring the applications and po- 
tentials of these new technologies. Wil- 
liam Osier, on stressing the importance 
of organizing and extending smaller li- 
braries in medical societies or hospitals 
for continuing education of physicians, 
wisely pointed out, “It is much simpler 
to buy books than to read them, and 
easier to read tliem than to absorb their 
contents.” (5) In a similar view, it is 
much easier to introduce computers into 
libraries than it is to design systems for 
their productive and efficient use. 

Historical Development of Library 
Automation 

The mechanization of data processing, 
including both what is known as EAM 
( Electronic Accounting Machinery) and 
the newer computer equipment, has an 
intricate and somewhat elusive history. 
As early as 1780 Joseph Marie Jacquard 
Invented a machine in which perforated 
cards controlled the pattern of hooks 
and needles for use in weaving; the 
English mathematician, Charles Bab- 
bage, conceived the idea of an automat- 
ic digital computer about 1835. He 
called his proposed machine an “analyti- 
cal engine”, but was unable to complete 
a working model before he died in 1871. 
(6) It is generally acknowledged that 
the first operational device using perfo- 
rated cards for tabulation and statistical 
purposes was developed in the 1870’.*i, 
and represents the real genesis of the 
present multi-mllllon-dollar data pro- 
cessing industry. 

The invention of the electrical tabu- 
lating machine using punched cards is 
generally attributed to Herman Holler- 
ith, a statistician, who was working at 
that time for the United States Census 
Office. But from his own records, and 
those of others, it is clear that it was a 
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physician who first suggested to Holler- 
ith that an electrical machine utilizing 
punched cards should he developed for 
use in the 1880 census. This physician 
was Dr. John Shaw Billings, the princi- 
pal figure in the history of the present- 
day National Library of Medicine, serv- 
ing as its first director from 1865 to 
1895, and unquestionably the pre- 
eminent figure in the entire fiela of 
medical librarianship. 

Serving as a consultant to the Census 
Office, Billings suggested in 1880 “that 
the various statistical data of the living 
and the decedent mi^t be recorded on 
a single card by punching small holes in 
it and that these cards might then be as- 
sorted and counted by mechanical 
means according to any selected groups 
of these perforations.” (7) The electrical 
tabulating machine developed as a re- 
sult of these suggestions was actually 
used in connection with the 1880 mortal- 
ity records of the city of Baltimore, in 
the Surgeon General’s Office for compil- 
ing and tabulating Army health statistics 
in 1889, and in the handling of data col- 
lected in the United States Census of 
1890. 

The extension of these earliest devel-. 
opments to library applications was 
non-existent until the middle of the 20th 
Century. It is true, however, that me- 
chanied means for expediting library 
work have been considered for maijiy 
years, although not in what would g(m- 
erally be considered tlie data processing 
area. The very first volume of the fore- 
runner of the Bulletin of the Medical Li- 
brary Association, the Medical Library 
and Historical Journal, dated 1903, con- 
tained an article on the use of the “type- 
writing machine” in cataloging. In addi- 
tion, telephones have long been accept- 
ed as library machines, and, efoept for 
unusual items, hand hookbrnding has 
given way to machine-bound books. It 
was not tmtil the late 1940Vi, however. 



that a few libraries began using unit rec- 
ord equipment for their various business 
operations such as purchasing and pay- 
roll. 

As computers became available, a few 
industrial and research libraries began 
limited information storage and retrieval 
work using these devices. Basically, 
these early systems closely resembled 
the processing done with the usual pay- 
roll and personnel records — formatted 
files, read serially. The development of 
the following generations of computer 
hardware and improved software tech- 
niques have led to extensive experimen- 
tal work searching for effective applica- 
tions to library operations. Probably the 
most significant advances in terms of the 
wmputer’s application to information 
storage and retrieval have been the tre- 
mendous increase in computer storage 
and the capability for a series of users to 
query the central computer file simulta- 
neously and from remote locations. 
These developments have opened a new 
era for the advancement of library serv- 
ices. 

Despite these applications and signifi- 
cant developmental activities in the 
1960’s, library automation is sUll in its 
infancy. An exhaustive literature survey 
conducted by Donald Black and Earl 
Farley for the publication of the first 
volume of the Annual Review of Infor- 
mation Science and Technology (8) in- 
cluded ve\y few articles covering as- 
pects of library automation systems in 
operation or planned in any single li- 
brary. T’he overwhelming preponder- 
ance of the literature consisted of why 
automation is the coming thing, why 
one should become familiar with what 
machines can do, and discussed various 
applications to one library function or 
another. 

Automation of Library Activities 

The \vord “system” as used in scientif- 
ic management or related to the scientif- 






ic method of problem solution desig- 
nates an organization of interacting 
parts intended to accomplish a particu- 
lar purpose. This rather all-encompass- 
ing definition can include a wide variety 
of activities not the least among which is 
the library. The library is certainly in- 
tended to accomplish a particular pur- 
pose, or more accurately a series of pur- 
poses, although these are all too often 
forgotten in the busy days of “doing 
things”. Certainly the library can also be 
properly considered an organization of 
interacting parts. 

System analysis is a method of han- 
dling complex problems — a method so 
simple and yet so powerful that it has 
been applied successfully to problems in 
engineering, business, and government. 
If a library is truly a system and system 
analysis has proved so valuable to other 
enterprises, this method of problem so- 
lution should be equally successful for 
library operations. An examination of a 
library from the systems analysis view- 
point is desirable before considering the 
mechanization of its activities. 

Systems analysis demands the state- 
ment of both final objectives and of in- 
termediate objectives. Otherwise there is 
no way in which design and perform- 
ance can be measured anej evaluated. 
Libraries may have many objectives or 
purposes. There have been a number of 
efforts to state these purposes in systems 
terms. It can be said, as V. W. Clapp 
has done, . . . “to provide access in bib- 
liographic and physical terms to the rec- 
ords of human communication”; (9) or 
as stated by Becker and Hayes . . . “to 
obtain, preserve and make available the 
printed materials required for use by its 
patrons and in so doing to store record- 
ed knowledge for future generations.” 
(10) These expressions provide a back- 
ground against which each element or 
part of the library system can be tested. 

ITie purposes and objectives of medi- 



cal libraries have been outlined in the 
opening paragraphs of this paper, par- 
ticularly the role of the medical library 
in medical education. Health-related ori- 
entation makes medical libraries dis- 
tinctive in that the user population is 
considerably more homogeneous than in 
a general library, and the emphasis that 
has been placed on the library’s role in 
medical education requires an active 
rather than passive role so typical of 
most libraries. These distinctions require 
careful consideration by those engaged 
‘.n analysis, design and management of 
medical libraries. In spite of these 
differences, it is equally true that many 
of the detailed functions required within 
.any library are basically similar. 

Operationally, all library systems em- 
ploy four basic processes: the acquisi- 
tion of publications, the creation of sur- 
rogates for the items, the storage of 
both, and the access to one or both upon 
request. In accomplishing this work, 
most library practice revolves around 
the records that are kept of the books, 
documents and periodicals that make up 
the main store of the library. The li- 
brary, thus, is essentially a set of files. 
The basic set are the items themselves; a 
second set are those providing access to 
these items; and a third set are the nec- 
essary administrative type files. The 
creation and processing of these files 
and records presents an enormous data 
handling problem for tlie librarian. It is 
readily understandable that Dr. Billing.', 
as a librarian, would be a leader in me 
development of mechanized data pro- 
cessing equipment, but equally puzzling 
that so little use was made of it through 
the years by the libraries of the world. 

The first inventory of library automa- 
tion activities was carried out in mid- 
1966 by Creative Research Services, 
Inc., for the Document Division of the 
Special Library Association and the Li- 
brary Technology Program of the Amer- 
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ican Library Association. The report 
( 11 ) tabulates the extent of mechaniza- 
tion and automation plans of 1130 insti- 
tutions of 6150 which replied to the mail 
questionnaire. 

The stati-stics resulting from this sur- 
vey indicate that the typical mechanized 
library is a university or special library 
with a collection of over 50,000 bool« 
and more than 1,000 periodical titles. It 
has a staff of at least ten but no more 
than twenty members, evenly divided 
between professional and non-profes- 
sional. It has its serial control function 
running on electrical accounting ma- 
chinery ( EAM ) and its accounting 
function running on computers. The fa- 
cilities of the library’s host organization 
are used rather than the machine equip- 
ment owned or leased by the library it- 
self. This typical library has plans to 
mechanize its circulation conbol and 
accession list functions in the next one 
to two years. (This description of the 
typical library was derivedf by Eugene 
B. Jackson from the statistics taken from 
thesiurvey.) (12) 

Although such a typical library is only 
a creation from statistics compiled 
through a survey and the data are now 
almost two years old, it does give some 
indication of present conditions. Perhaps 
more meaningful are tlie statistics shown 
in Figure 1 for the various library func- 
tions. The total 638 represents the mun- 
ber of libraries reporting some use being 
made of either electrical accounting ma- 
chinery (EAM) or automatic data pro- 
cessing (ADP) equipment. As shown by 
the percentage figures, progress has 
been made toward automating conven- 
tional library operations. 



First EAM and now a growing num- 
ber of ADP systems have been adopted 
fo** the control of the hbrary’s manage- 
ment data in functions such as account- 
ing and in the processing activities rep- 
resented by acquisition, serials control, 
announcement lists and book catalog 
and catalog card production. In the 
areas more directly related to service to 
the users, the progress toward automa- 
tion has been generally slower. This is 
the phase of operations involving the 
question of which dociunents in ^e li- 
brary contain information on a specific 
subject. As Adkinson and Stearns have 
stated, (13) in the first phase (manage- 
ment data and processing activities) we 
have automated our inventory control 
over packages of information; in die sec- 
ond phase (the service to users), we are 
extending our efforts to automate into 
the process of determining which pack- 
ages in the inventory contain answers to 
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Figure 1 Use and plans lor use of EAM and/or ADP equipment in libraries and information 
centers. 

Note: Selected statistics from The Use of Data Processing Equipment by Libraries and In- 
formation Center'; n survey prepared fjr Document Division, SLA and Library Technical 
Program, ALA under a grant by the Council on Library Resources; submitted by Creative 
Research Services, Inc. 



particular questions. The function listed 
in Figure 1 as “retrospective searchos” 
covers this latter activity and the per- 
centages of 12 and 24 shown in the table 
are higher than one might expect. This is 
somewhat misleading when placed in 
the restricted context of libraries; but is 
explained by the reminder that the sur- 
vey included the information systems of 
industry where some of the more signifi- 
cant progress has been made in the au- 
tomation of retrieval operations. There 
are, of course, notable exceptions to this 
generalization, and in the medical field 
these exceptions exist largely because of 
tlie availability of the automated biblio- 
graphic citation file known as MED- 
LARS (Medical Literature Analysis and 
Retrieval System), establish^ and 
maintained by the National Library of 
Medicine. 

Medicd Library Applications of Auto- 
mation 

The automation efforts at NLM were 
first directed toward support to the pub- 
lication of Index Medicus. Beginning in 
1964, the Library placed the biblio- 
graphic citations for the articles selected 
for entry into Index Medicus on a mag- 
netic tape and used a computer to 
generate a printed output. Since August 
of that year, the printing has been ac- 
complished with the use of the comput- 
er file and NLM’s GRACE (Graphic 
Arts Composing Equipment). This same 
machine-readable file of citations now 
supports the most significant and far- 
reaching example of computer applica- 
tion to retrospective searching of medi- 
cal literature. 

The MEDLARS file now contains ap- 
proximately 750,000 citations to articles 
from about 2400 selected medical jour- 
nals. It can be entered through the se- 
lective use of the terms in a controlled 
vocabulary for the retrieval of the quali- 
fying citations. It requires trained 



searchers to transpose a users question 
into the proper search formulation, the 
punching of a deck of cards for entry 
into the computer, and then the serial 
searching by the computer of the file for 
the citations. This is a batch computer 
operation, i.e., searches are batched in 
groups of 30 to 40 and are entered to- 
gether for a single pass against the total 
file, print-outs are made of the retrievals 
and the results forwarded to the reques- 
tor. 

The principal operating techniques of 
MEDLARS for constructing and organ- 
izing machine-readable records, and for 
the searching and retrieving from these 
records, still require the human to assign 
words as labels to represent the contents 
of the documents. Then, upon searching, 
he must transpose a question into the 
same labels and express them in logical 
relationships in order to retrieve the 
item desired. The human intellect and 
ingenuity have been put to the test to 
provide effective schemes by which this 
matching of terms describing the query 
with those used as input descriptors can 
be accomplished. The controlled vocab- 
ulary used in the MEDLARS system is 
an example of one of the more success- 
ful efforts to reach this goal. This vocab- 
ulary consists of approximately 7000 
medical subject headings ( Medical Sub- 
ject Headings — MeSH) and includes a 
significant hierarchical structure to as- 
sist in both indexing for input and as- 
signing terms for retrieval. 

The NLM computer capability also 
supports the publication or a series of 
products in addition to Index Medicus. 
The MEDLARS file is used to produce 
a monthly Bibliography of Medical Re- 
views, including articles from publica- 
tions such as the Annual Review series 
and Nutrition Reviews and articles 
termed “review” in such journals as the 
New England Journal of Medicine. 
These are of great value to students and 
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to individuals entering a new field of 
medical endeavor. 

Retrospective literatiure searches that 
are accomplished in MEDLARS are also 
published for general distribution when 
their subject matter is judged to be of 
relatively wide interest. For example, 
NLM has published a literature search 
titled Computers in Medicine and Biolo- 
gy that contains 327 citations to articles 
indexed for MEDLARS from mid-1964 
through December 1967. A sampling of 
titles of other published seardies in- 
cludes Tumors of Cold-Blooded Verte- 
brates, Neoplasm Models, Clinical Stud- 
ies Involving Estrogens, Epidemiology 
of Suicide, and Exercise and the Elec- 
trocardiogram. 

The NLM Current Catalog is a prod- 
uct of particular importance to the 
country’s medical libraries. It is issued 
on a biweekly basis and citations are cu- 
mulated quarterly. The biweekly issues 
contain citations to publications cata- 
loged by NLM which have an imprint 
date of the current or two preceding 
years. Cumulations include citations 
to all publications cataloged by the li- 
brary, regardless of the date of imprint, 
except for titles published before 1801 
and certain other special publications. 
In accordance with the Library’s goal of 
improving and enhancing access to sig- 
nificant momedical literature, the 19^ 
Current Catalog contains, for the first 
time, separately listed citations to tech- 
nical reports which have been acquired 
for the NLM collection. 

The National Library of Medicine is 
currently developing a complete auto- 
mated system as a second generation to 
the present MEDLARS. The contractor 
is being selected to perform the systems 
design, hardware installation, and pro- 
gram implementation — a project that is 
scheduled over a five-year period. The 
new system will meet future data pro- 
cessing and information system require- 



ments for: 1) an increase in the level 
and speed of MEDLARS bibliographic 
services provided, including demand 
searches and recurring bibliographies; 
2) an automated acquisitions and cata- 
loging system; 3) an on-line augmented 
Medical Subject Headings vocabulary to 
aid those responsible for indexing and 
searching; and 4) a drug literature pro- 
gram with search capabilities on chemi- 
cal compounds. In addition, the new 
equipment will be capable of expansion 
to accommodate computer processing 
required by a graphic image storage and 
retrieval system closely linked to the 
MEDLARS search capability. 

Another development recently begun 
in computer application at NLM is the 
automation of film distribution activities 
at the Library’s National Medical Au- 
diovisual Center in Atlanta. A computer- 
ized system is being developed for book- 
ing fihns, preparation of shipping docu- 
ments, inventory and suspense control, 
collection of utilization data, and reports 
to program sponsors. Plans call for a sys- 
tem which would combine source data 
automation and data processing tech- 
niques for maximum manipulation of 
data to produce the necessary reports, 
and for handling loan transactions with 
maximum speed and efficiency. 

There is significant developmental 
work being conducted in other medical 
libraries to apply the new computer 
technology. The organization of a new 
medical school library at the University 
of New Mexico has offered a unique op- 
portunity to develop machine methods 
of bibliographic control and to use elec- 
tronic data processing for library func- 
tions. The University has been the recip- 
ient of a research grant from the Nation- 
al Library of Medicine to develop a to- 
tal system of library operation based 
upon such automated support. The de- 
velopment program has included the 
functions of acquisitions, cataloging se- 
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rials control, accounting, circulation and 
interlibrary loan. The serials control pro- 
gram has shown successful use of EAM 
equipment for the past four years for 
the activities of ordering, receiving and 
processing, claiming, producing current 
listings, and others. The circulation pro- 
gram includes the use of the IBM 357 
Data Collection System for control pur- 
poses. A borrower presents a pre- 
punched plastic identification card and 
this with a prepunched book card gener- 
ate a transaction record. This is reported 
to be an effective, accurate, fast and rel- 
atively simple process. Preparation of 
overdue notices is done in a matter of 
minutes and management information 
about circulated items, borrowers, etc., 
is made readily available. 

Current work is being conducted on 
adapting to improved machine capabili- 
ties at the Washington University 
School of Medicine Library, St. Louis, a 
leader in library automation. (14) In 
1963, this library was reporting efforts 
in the area of automation, specifically 
»he printing of acquisition lists from 
magnetic tape files and the publishing 
of periodical holdings first from cards 
and later from tapes. A year later re- 
ports were released on the operational 
circulation records and control system 
and more recently this library has de- 
scribed its system for producing book 
catalogs from a single punched card in- 
put, manipulated by a computer under 
the control of programs written for the 
task. Work continues to improve these 
operations and to expand the support re- 
ceived from automation. For example, 
the acquisitions and cataloging records 
stored on magnetic tape have been ex- 
amined to determine frequency and av- 
erage length of record components and 
their alphabetization requirements in a 
book catalog. Data from this study are 
being used in adaptation of the library’s 
computer-based cataloging system to 



greater machine capabilities. 

The State Universities of New York 
(SUNY) have undertaken a series of 
projects in the various areas of library 
automation. A principal effort was the 
use of a computer to support the publi- 
cation in 1965 of a State University Un- 
ion List of Serials intended to facilitate 
the sharing of serial resources. The first 
edition was published in the fall of 1966 
and contained 17,000 titles; the second 
edition, dated December 1967, included 
25,000 titles. This publication has trig- 
gered a significant increase in intercam- 
pus exchange — or interlibrary loan. The 
interuniversity transaction at the Up- 
state Medical Center rose from almost 
zero to 15-20% of the total activity at that 
library. SUNY has also assumed a role of 
leadership in the development of a 
biomedical communications network, 
described later in this report. 

The medical libraries of Columbia, 
Harvard and Yale collaborated on a 
computerization project including the 
printing of catalog cards and biblio- 
graphic lists. Their first product was a 
monthly accessions list that appeared in 
October 1963. Although this project has 
since been terminated, it represented a 
significant effort in cooperative library 
activity based on computer support. The 
Yale University Medical Library, contin- 
uing with a computerization project, de- 
veloped a program in 1966 to produce 
book-form catal^s and catalog cards, 
using the IBM "i^4-7040 Direct Cou- 
pled System. An acquisitions and in- 
process control system utilizing comput- 
er suppoit has also been designed by 
Yale covering the activities from request 
for purchase to cataloging and shelving. 

Information System Evaluation 

Are our efforts to automate accom- 
plishing the intended purpose? Have we 
spent money for apparent sophistication 
but not really improved in the efficiency 



of our job, the quality of our work or, 
the most important criterion, the service 
to our customer? In many cases, the 
only honest answer is we don’t really 
know. The capability to evaluate the re- 
sults of our efforts scientifically has 
proved to be a very difficult task. As 
Ruth Davis, Associate Director of Re- 
search and Development at NLM, has 
stated . . . “The hopes or wishes of 
those concerned with the evaluation of 
information systems is to apply methods 
of the physical sciences to such evalua- 
tions.” (15) She goes on to point out the 
fallacies of such approaches for systems 
where the human being — both as an 
observer and user — plays such a domi- 
nant role. Observation itself can effect 
change. The user of the information sys- 
tem is often considered a part of the sys- 
tem itself and yet represents an area of 
many unanswered questions. On the 
other hand, John Tukey of Princeton ex- 
pressed the opinion that there are, in the 
information systems area, things to do 
that are obviously useful enough to need 
no formal detailed testing. He has con- 
jectured that “the real proof of the value 
of change is how much it hurts if you 
try to return to the old ways.” (15) 

There have been a limited number of 
cases where major operational informa- 
tion systems have been subjected to 
large-scale evaluation efforts. A national 
conference on Electronic Information 
Handling was held in Pittsburgh in 
April of 1967. It was designed to focus 
attention on new ideas, research and de- 
velopment in the techniques of testing 
and evaluating electronic information 
handling systems. The report of the 
conference is contained in the publica- 
tion titled Electronic Handling of Infor- 
mation: Testing and Evaluation, edited 
by Kent, Taulbee and Belzer. (15) It is 
recommended as an excellent reference 
on this difficult subject. In addition, a 
chapter has been devoted to the subject 



of Evaluation of Information Systems 
and Services and vmtten by Alan Rees 
in the Annual Review of Information 
Science and Technology, Volume 2. 
(16) This covers a general discussion of 
testing and evaluation as well as a re- 
view of the efforts in laboratory-based 
testing and evaluation, tests of operating 
systems, and research in problem areas. 

One of the few major information sys- 
tems to “bare its soul” to the public is 
the MEDLARS system. The evaluation 
of this system is the most elaborate and 
sophisticated performance study to date 
of an operational system. A complete re- 
port of this study by Lancaster is now 
available tlu-ough the Government Print- 
ing Office. (17) 

The study concentrated on the evalu- 
ation of the demand or retrospective 
search function. Over 5,000 searches per 
year are performed at NLM with addi- 
tional searches being run at decentral- 
ized centers in the United States and in 
England and Sweden. The principal ob- 
jectives of the test were: 1) to study the 
demand search requirements of the 
MEDLARS users; 2) to determine how 
effectively and efficiently these require- 
ments are being met; 3) to recognize 
factors adversely affecting the system; 
and 4) to disclose ways improvements 
can be made. The evaluation was a com- 
plete system evaluation since it included 
all components affecting the perform- 
ance of the system as measured by the 
satisfaction of the MEDLARS users. 
The study was g’jided and reviewed by 
an external board of advisers, who were 
selected for their pre-eminence in the 
fields of information science and/or sta- 
tistics. 

The analysis of a carefully selected 
sample of 300 searches revealed that for 
an “average” search somewhat over 
one-half of the citations in the file that 
were relevant to the request were re- 
trieved and that of those citations that 
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were retrieved between one-half and 
hvo-tliirds were judged to be relevant 
by the requestor. These are considered 
to be good results when compared with 
the performance of other systems, al- 
though such results are difficult to com- 
pare because of the variety of methods 
used to arrive at the expressions of per- 
formance. 

A principal cause of the failure to re- 
trieve a relevant item was that the in- 
dexing was not exhaustive enough. Re- 
trieval of irrelevant items was due, at 
least in part, to lack of specificity in 
searching. However, the greatest poten- 
tial for improvement was judged to be 
the interface between the user and the 
system. Over 20% of the system failures 
were traced to defective interaction in 
this area. There is need for more intel- 
lectual effort and care in the statement 
of the requirements on the part of the 
user. Other results highlighted include: 
1) need for improved vocabulary con- 
trol and updating; 2) 45% of input effort 
required for foreign language material 
with comparatively small acceptance of 
users; 3) bibliographic record as output 
to the user is not adequate to indicate 
article content; and 4) the need for a 
continuing quality control mechanism 
for the future. These areas are all under 
present consideration by the manage- 
ment of NLM. 

Networking and Cooperative Activities 

There is little evidence in the litera- 
ture that there has been a change from 
the absence of a “total system” concept 
of library automation as noted by Black 
and Farley in their review^ of the 1965 
literature. (8) They expressed the opin- 
ion that . . . “Were a total system con- 
cept ever to be implemented within a li- 
brary, it would certainly blur the dis- 
tinctions between such traditional de- 
partments” . . . (circulation, acquisi- 



tion, cataloging, serials, etc.). They con- 
tinued . . . ‘This leads one to suspect 
that much of the reluctance on the part 
of many librarians to undertake work in 
automation may stem from the fear that 
automation will force significant 
changes in existing organizational struc- 
tiKes. That fear is certainly justified. 
However, the continued fragmentation 
of library operations tends to isolate the 
operating divisions from their goal, 
which is, of course, service to a group of 
users.” 

It is recognized as difficult to make 
radical changes in large operations but 
the real advantages to be offered by au- 
tomation will not be realized until the 
entire library is recognized as a single 
system and treated accordingly. In reali- 
ty, this is not even a broad enough out- 
look. The individual medical library 
should be considered as a subsystem, or 
component, of a much larger system — 
the national biomedical communications 
network. We believe that the local li- 
brary can be developed into a respon- 
sive biomedical commimication resource 
as an integrated part of an expanded 
comprehensive service network. A 
stronger national network is urgently 
needed to serve the information needs of 
all personnel in the medical sciences. Its 
aim should be to permit equal and rapid 
access to all types of biomedical infor- 
mation. 

Networks to librarians are nothing 
new. Well before this word became 
fashionable and before the advent of 
modem computers and electronic com- 
mimication systems, interlibrary loan 
networks among libraries on a regional 
and national scale were created and op- 
erated by members of the profession. 
The complex systems of national and re- 
gional bibliographic control in the form 
of union lists and catalogs, of interim 
soiurce referral services, and the large 
and growing traffic in interlibrary loans 
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clearly identify the library system as a 
viable de facto network, not ordinarily 
recognized as such by its patrons. But 
with the newer tools provided by our 
advancing technology, the network 
takes on a completely new dimension. 

The planning, design and implemen- 
tation of the Biomedical Communica- 
tions Network has become a principal 
task of the new research and develop- 
ment office at the National Library of 
Medicine. This Network is the embodi- 
ment of NLM’s plans to provide im- 
proved access to information within the 
medical community for the support of 
continuing education, individual practi- 
tioners and researchers, and institutions 
such as hospitals, clinics, and research 
centers. 

At least for initial planning purposes, 
the Network has been divided into sev- 
eral components by type of service to be 
provided. These components are for li- 
brary services, specialized information 
services, specialized educational services 
and audio and audio-visual services. 
Supporting these four service areas will 
be the data processing centers and 
transmission facilities. 

Planning is most advanced for the li- 
brary component, as might be expected. 
Predating this formalized program was 
the establishment of decentralized cen- 
ters at UCLA, Harvard, University of 
Micliigan, University of Alabama, Uni- 
versity of Colorado, and Ohio State for 
MEDLARS searches. Search formula- 
tion is accomplished at all of these cen- 
ters, with cards punched for computer 
input. Some of the centers are actually 
r unnin g their own machine searches us- 
ing MEDLARS computer tapes provid- 
ed by NLM and some are sending the 
punched cards for searches to be made 
on NLM’s equipment. Several are now 
transmitting the search requests to NLM 
through card readers and telephone 
conununications links, thus, creating a 



duplicate card deck at NLM for input to 
its computer. 

An early part of the research and de- 
velopment program has been the estab- 
lishment of a Remote Information Sys- 
tems Center to serve both the library 
and specialized information components 
of the Network. This Center is the ter- 
minal facility at the Library for commu- 
nications links to a variety of data sys- 
tems and provides remote access to sev- 
eral computer centers and to the decen- 
tralized MEDLARS centers. The pur- 
poses of these links are to provide access 
to remote data banks, support experi- 
mentation with the research and devel- 
opment of others in the information and 
computer sciences, provide a capability 
to demonstrate techniques and the 
state-of-the-art in information storage 
and retrieval, and to assist in the data 
manipulation needs of the Library. The 
ability to sit at a teletype in the Center 
and to query a file of citations stored on 
a computer in California, to receive al- 
most instantaneous response with the ci- 
tation requested typed in front of you 
by data transmission from the computer 
is truly a remarkable experience. And 
yet this is imsophisticated input/ output 
compared with the cathode ray tube 
devices now available. Such remote 
query capability utilizing computer time- 
sharing will be a principal element of the 
planned services and, nopefully, in the 
not-too-distant future. The establishment 
of this center represents the first tangible 
manifestation of communications net- 
work activity at the Library. It will serve 
as an operating input/output point for 
the Library and specialized information 
service components of the Network. 

The planning for the specialized edu- 
cational services places an emphasis on 
the needs of continuing medical educa- 
tion but includes the needs of the medi- 
cally uninformed, particularly those 
without the knowledge of basic and es- 
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sential family health rules. Television is 
the principal medium being considered 
and plans include the use of satellites to 
aid in transmission. This is a radical de- 
parture from the traditional activity of a 
library, and is an example of a need that 
has been expressed for the applications 
of new technology to the medical infor- 
mation requirements of society. 

Biomedical communications network 
planning and experimentation is also im- 
derway in the State Universities of New 
York (SUNY). In 1965, the SUNY ad- 
ministration received a proposal from a 
task force recommending the establish- 
ment of a biomedical communications 
net^vork. This network was to link the 
Health Sciences Library at Buffalo, the 
Upstate Medical Center at Syracuse and 
the Downstate Medical Center at Brook- 
lyn. It was proposed as a computer-cen- 
tered network and recommended to 
serve as a prototype for the University- 
wide library system which includes ^ 
separate libraries. The stated purpose 
was to retrieve bibliographic informa- 
tion relating to books and joiumals 
owned by the three libraries and by the 
National Library of Medicine. Later 
plans called for the addition of material 
in related sciences and, finally, for auto- 
mation of in-house routines of the librar- 
ies, leading to cooperative or coordinat- 
ed acquisition and processing of new 
materials. SUNY accepted the proposal 
and designated it as a pilot study. The 
network is to begin operations in the fall 
of 1968. 

Network development and plans are 
imderway in several other state library 
groups. For example, medical librarians 
have recently organized the Texas 
Council of Health Science Libraries to 
improve their cooperative, interlibrary 
activities, and they are looking ultimate- 
ly to some type of network interconnec- 
tion. Teletype services are already being 
used to support interlibrary loan activi- 



ties among five of the institutions in the 
North Texas Interuniversity Council, 
and in the Gulf Coast area a Regional 
Information and Communication Ex- 
change centering on Rice is experiment- 
ing with teletype and computer services 
to participating libraries in all of the 
coastal counties. 

Cooperative actions among libraries 
of the United States have too frequentl)* 
been limited to interlibrary loaning of 
materials, discussions at conventions, 
and discussions in the literatme of com- 
mon operating problems. Automation 
has increased the awareness of the need 
for improved and extended cooperation 
because of the potential advantages of 
sharing work and resources through ex- 
change of records and linking by net- 
works. A new era in library cooperation 
was opened in June 1967 when the di- 
rectors- of the three national libraries — 
the Library of Congress, the National 
Agricultural Library and the National 
Library of Medicine — announced the 
establishment of the National Libraries 
Task Force on Automation and Other 
Cooperative Services. The purpose — to 
speed the flow of research information 
to the nation’s libraries and to the schol- 
ars and researchers who use them. 



The Task Force has issued its first 
progress report which contains a list of 
desirable products and services to be de- 
rived from the combined efforts of the 
three libraries, including book 
catalogs, machine-readable cataloging 
data, demand bibliographies and coordi- 
nation of classification, acquisitions and 
reference services. The report’s recom- 
mendations are now being used as a ba- 
sis for further discussions. Working 
groups have been established to attack 
each problem or functional area and 
there are signs of real progress toward 
unified action. 

Special mention should be made of 
the progress toward the establishment of 
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a standard format for machine-readable 
cataloging (MARC) and the distribu- 
tion of catalog tapes in that format by 
the Library of Congress. Much of this 
work on MARC was accomplished by 
the Library of Congress prior to the es- 
tablishment of the Task Force but now 
is included in its program. Details of the 
project are covered in the reports au- 
thored by Henriette Avram and others 
listed in the references. (18) (19) 

Representatives of the three libraries 
are also meeting to discuss and plan foi 
a system framework within which to 
place the total effort. It is hoped that 
not only will this \vork lead to a forerun- 
ner of a truly national library network 
but that it will stimulate others in the li- 
brary community to increase their coop- 
erative efforts. 

Summary 

The use of computers in libraries can 
be summarized as supporting two main 
purposes: the handling of records gener- 
ated in the library’s operation, and the 
automatic extraction and codification of 
information in the library’s files for use 
by clients. 'The feasibility, utility, or 
technical availability of the former ap- 
plication is well documented. The latter 
task requires considerably more research 
before practical application \vill be com- 
mon. 

The emphasis that has been placed on 
automation, computers and the advances 
in information science should not 
leave the reader with false impressions 
concerning the future of the medical li- 
brary. In spite of the impressive changes 
in the technology of information storage 
and retrieval, the traditional library vidll 
continue to serve as a vital instrument in 
the educational process. 

In the report prepared by the Library 
Study Committee of the Association of 



American Medical Colleges titled the 
Health Sciences Library: Its Role in Ed- 
ucation for the Health Professions, this 
position was supported by a listing of 
several cogent reasons. (20) Included 
were the need for the display of llio 
printed word through traditional meth- 
ods, the requirement for the housing of 
certain documents that are classics or 
original in their presentation, and the 
need for the older portion of the scien- 
tific record that will probably not be 
economical to transfer to some newer 

media. 

This is not to end, however, on a note 
of status quo for the libraries. They 
must begin an active period of research 
into the most effective ways to dissemi- 
nate material that is of particular inter- 
est to the individual scientist and mate- 
rial that is new. The libraries must be 
willing to accept an educational role 
that is much beyond where they stand 
today. TTiis should include at least the 
education of the student of the health 
sciences \vith the form in which the 
scholarly record is contained and the 
means by which one gains access to it, 
and to identify, attract, and educate 
new talent for the increasingly special- 
ized field of information management. 
Finally, the health science library will 
have to adopt a new philosophy in the 
area of service. It must include eventu- 
ally the provision of linkages between 
people and information as well as be- 
tween people and documents; availabili- 
ty to the latest significant current events 
in professional societies, conventions, 
meetings, hospitals and laboratories; and 
development of selective dissemination 
services. The challenge is before the li- 
braries and the scientific and technical 
community is demanding that they ac- 
cept it. 
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SUMMARY 

COMPUTERS IN MEDICAL LIBRARIES'* 

Panel: Martin M. Cummings, M.D., Chairman, Irwin Pizer, Robert T. Divert, Leonard Eddy. 



The panel on Computers in Medical 
Libraries was pleasantly surprised to 
find an audience of approximately 30 
participants, and the word * partici- 
pants” should be emphasized because 
more than half of the alloted time v/as 
spent in active dialogue between partici- 
pants and panel members. In an attempt 
to meet the charge, a statement of gen- 
eral purpose has been developed. 

The importance of the medical library 
as a learning resource for education is 
reflected in many ways. Local, state and 
federal institutions and organizations 
are deploying more funds and manpow- 
er in an effort to restore this instrument 
of education and learning to a tool of ef- 
fectiveness and efficiency geared to 
match the expansion of the total educa- 
tional needs of ovu* nation. Libraries are 
seizing this opportunity to use the com- 
puter and related new technologies to 
solve some of the existing information 
problems. There is still need, however, 
for refinement and further discrimina- 
tion in application of computers to this 
enormous set of communications prob- 
lems. The most encouraging evidence 
that success is close at hand comes from 
conferences such as this one in which 
educators, administrators and librarians 
are sharing views, experiences and rela- 
tionships critically, candidly and cooper- 
atively. To share resources on a national 
basis, plans for developing local, region- 
al and national library networks seem to 

* Presented by Martin M. Cummings, M.D., P 
conference. 



be advancing at a rapid pace. The need 
to consider standards for compatibility 
among computer systems has been rec- 
ognized and much work is underway to 
bridge program and hardware dispari- 
ties in an effort to effect economy and 
efficiency of operations. 

It has been estimated that more than 
90% of all health personnel that have ever 
dedicated their lives to research are 
alive and working in laboratories and 
clinics today. As a result, the immense 
growth of knowledge and printed matter 
since World War II has caused a great 
concern among those who need to find 
and use this information. In 1963, it was 
estimated that the growth rate of publi- 
cations over the previous 20 years had 
been about 3.1% per year, doubling every 
22 years. More recent estimates reflect a 
doubling every 11 years. It was further 
estimated that information in the world’s 
libraries is growing at a rate of 2 x 10* 
bits per second (a bit in this context 
being approximately equivalent to half 
of one letter or one numeral). This 
growth has created severe strains that 
are beginning to break down the effi- 
ciency of all methods of information 
handling that heretofore have been rea- 
sonably adequate. As a result, a new 
methodology of information handling is 
developing. This methodology is based 
upon the ability of computers to per- 
form some of the routine functions of in- 
formation management and processing 

el Chairman, at the closing plenary session of the 
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previously handled by man alone. The 
predecessor of the computer was the 
punch-card accounting machine devel- 
oped by Hollerith and Billings, and the 
use of the punch-card equipment in li- 
braries goes back to the early 1930’s. 
Since that time, a few libraries have 
been using this methodology for some of 
their routine library procedures. Among 
the first libraries to use punch-cards was 
the University of Texas where Ralph 
Parker developed a punch-card circula- 
tion system, since adopted by many oth- 
er places. 

There have been two schools of 
thought concerning the use of comput- 
ers in information handling. The librari- 
an, for the most part, has looked at the 
computer simply as a means of accom- 
plishing the traditional tasks of libra- 
rianship. The documentalist, on the oth- 
er hand, has looked at the computer as a 
potential means of storing, retrieving 
and manipulating information of all 
^es. Vannevar Bush in 1945 published 
the provocative paper which has led to 
the most revolutionized thinking of 
those who are concerned with informa- 
tion management. From his report has 
germinated the concept of fact retrieval 
as opposed to citation retrieval, which 
has always been the librarian’s ap- 
proach. The ability to retrieve citations 
is a necessary prelude, however, to any 
effective machine retrieval of actual 
fact. Except in a very few cases, the 
technology of information science has 
not yet developed to the point where 
there can be fact retrieval oy machine. 
The National Library of Medicine has 
had some success with its medical litera- 
ture analysis and retrieval system, but 
its principal contribution has been to in- 
troduce computer technology on a fairly 
extensive scale within the library set- 
ting. It is now planning the develop- 
ment of a second MEDLARS system 
which will allow the use of time-shared 



computers in retrieving not only refer- 
ences or citations, but abstracts and se- 
lected portions of total text as well. 

Serious investigation of the use of 
computers for all library operations be- 
gan with the development of the new 
campus of the University of Illinois in 
Chicago. Shortly thereafter, one of tho 
leaders of the team at Illinois accepted 
the position as Director of Library and 
Information Services at the new Florida 
Atlantic University in Boca Raton. Dr. 
Heiliger put into effect at Florida Atlan- 
tic the plans previously developed at the 
Chicago undergraduate campus at the 
University of Illinois. I think we should 
point out that the Florida Atlantic pro- 
ject was not an unqualified success. In 
fact, some would say it was an abysmal 
failure and the panel believes that refer- 
ence to failures is important to recall 
and that we should not overemphasize 
our successes. Shortly after the Illinois 
report Dr. Estelle Brodman and Mr. Ir- 
win Pizer began a project aimed at total 
system library operations at Washington 
University School of Medicine in St. 
Louis. 

Selected library operations in this 
project have been developed successful- 
ly using the batch mode of computer op- 
erations. About the same time, Fred KU- 
gour. Librarian at the Yale Medical Li- 
brary, conceived of a project that would 
place the holdings of his great Library, 
those of the Harvard Medical School Li- 
brary, and those of Columbia University 
Medical Library onto a central comput- 
er storage device connected to each li- 
brary by leased lines and typewriter ter- 
minals using time-shying principles. Al- 
though Kilgoiu: had apparently worked 
carefully and meticulously to develop 
the software for this program, this effort 
failed for an entirely different reason. 
Harvard withdrew from this project, 
presumably for administrative or organi- 
zational reasons, so there is a second evi- 
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dcncc of failure, but in this case appar- 
ently not caused by a lack of technical 
planning. 

One cannot attempt to review devel- 
opments in this field without making 
reference to the exciting work which has 
been taking place at the Massachusetts 
Institute of Technology during the past 
decade and, in the interest of time, will 
only refer to the accomplishments of 
project MAC and its related and subsid- 
iary project TIP which has demonstrat- 
ed the ability of users to work on-line 
with massive data files generated, in 
fact, by the users themselves. The con- 
cepts emerging from this experiment 
have been seized upon by other groups 
in the evolution of subsequent on-line li- 
brary and data-based information devel- 
opments and perhaps the most signifi- 
cant of these is the second M.I.T. proj- 
ect, INTREX, which will attempt, be- 
tween now and 1975, to develop a fact 
retrieval library-based information sys- 
tem within the field of interest of engi- 
neering and other hard sciences. 

Returning to medicine, in 1963 the 
University of New Mexico began to es- 
tablish their new school. The University 
of New Mexico School of Medicine is a 
relatively young school, graduating its 
first class in June, 1968. The School of 
Medicine Library was faced with the 
task of building an adequate library in a 
short time. It was early decided to uti- 
lize machine methods to the fullest ex- 
tent possible. The first few months were 
spent in designing a punch-card system 
and in putting reco^ in machinable, 
form. It was found that no total system 
was available for use in the Library. It 
was necessary to borrow, modify, and 
redesign several programs to arrive at 
usable solutions to problems encoun- 
tered. This punch-card system has been 
gradually phased out in the past 
months, and is being replaced by batch 



proco.s.sing on an IBM 360 Model 40 
Computer. 

New Mexico i.s now doing research to 
design a total library on-line system — 
one which can, with only slight modifi- 
cation, be used in other libraries. One 
requirement is that the.se programs be 
written as nearly as possible in a univer- 
sal language. An IBM 357 Data Collec- 
tion System is now being utilized for cir- 
culation procedures, and a daily print- 
out is obtained, much as is done in many 
libraries across the country. 

Planning and implementing of on-line 
procedures is well under way. Two IBM 
226 CRT Terminals will be installed in 
the Library in June of this year, to be 
connected to the IBM 360 Computer. 
These terminals will be utilized in ac- 
quisitions and cataloging processes, as 
well as for serials control and circulation 
procedures. 

Acquisitions and cataloging' programs 
will be closely interrelated when the 
CRT Terminals are in operation. On re- 
ceipt of a book request, the acquisitions 
librarian will place this record on the 
computer. From this time until final ca- 
taloging, the original record will be re- 
called and supplemented or corrected as 
necessary on the CRT Terminal. 

The serials control program is similar 
to acquisitions procedures. A descriptive 
catalog entry will be made for each se- 
rial title. Receipt of a serial will be re- 
corded on the CRT much as is now 
done in a Kardex file. Claiming proce- 
dures are more difficult. The vagaries of 
publication and distribution of serials 
make necessary the development of a 
man-machine interface to effectively ac- 
complish this necessary claiming opera- 
tion. There is an anticipation period for 
each serial, a time period within which a 
particular issue is expected to arrive. 
This period might be 30, 60, or 90 days, 
for instance. Should the item not be re- 
ceived during the ant’eipation period. 
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this fact will be brought to the attention 
of the serials librarian. She will decide 
whether to claim any particular serial, 
and a completed claim will be produced 
when required. 

The primary impact on the user of the 
Library will be that, instead of going to 
a card catalog, he will go to a cathode 
ray tube terminal to begin a literature 
search. The computer will be pro- 
grammed to ask questions of the user. 
These questions and his answers will, 
hopefully, duplicate the thought proc- 
esses which take place in use of a tradi- 
tional catalog. The user should be able 
to locate needed information in less than 
a minute. Appropriate citations will then 
be displayed on the terminal or printed 
out on an attached printing unit as de- 
sired. One additional search method will 
be possible with the software being de- 
veloped — a TWX search. Any teletype 
station should be able to dial into the 
computer system and do a literature 
search to any depth. 

For all practical purposes, the com- 
puter system and library being devel- 
oped by the University of New Mexico 
School of Medicine is not a local system, 
but rather is a statewide or even region- 
al information center. 

This model was discussed in some 
depth by the panel with a view of deter- 
mining whether a system developed at 
one new medical school might be trans- 
lated or transferred to other new medi- 
cal schools. 

The panel then spent much time re- 
viewing the interesting developments on 
a state-wide medical library network 
which is being developed by the State 
University of New York. 

The State University of New York 
Biomedical Communications Network 
began in 1965. The Network now links 
State University Medical Center Librar- 
ies at Buffalo, Syracuse, Brooklyn and 
Stony Brook. In addition, the University 



of Rochester Medical Center and Alba- 
ny Medical Center Libraries have joined 
the Network. The collections of these li- 
braries total more than 600,000 volumes 
and more than 9,000 serials are currently 
received. 

An IBM 360 Model 40 Computer with 
IBM 2740 Communication Terminals 
are utilized in the Network. Exchange of 
interlibrary loan data, reference requests 
and other administrative messages con- 
cerned with the libraries and 3ie Net- 
work are facilitated as secondary appli- 
cations of the Network. 

The Network is primarily oriented to 
the user with goals and functions clearly 
stated as follows: 

1. Production of a computerized catalog 
of monographs in the three SUNY 
medical libraries, published from 
1962 onward. 

2. lEYoduction of union lists of serials 
and books with periodic updating 
(this may include the medical librar- 
ies, the entire 58 campus SUNY Li- 
brary System, or a combination of li- 
braries within the system). 

3. Search of the combined catalogs for 
all libraries for monographs bearing 
imprint dates of 1962-}-. Eventually 
10 years of book data will be stored 
on-line. The initial data base consists 
of approximately 20,000 records. 
These can be searched by author, ti- 
tle, subject, and other special fields if 
desired. 

4. Search of 5 years of MEDLARS data, 
to be obtained from the National Li- 
brary of Medicine. This anaounts to 
approximately 1,000,000 records, also 
stored on-line. These will be able to 
be searched by author (name) or 
subject, with the usual limiting 

arameters of time, language, sex, 
ate, etc. 

5. Search of the SUNY Union List of 
Serials data consisting of over 20,000 
current and non-current periodical titles 
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held in the 60 libraries of the State Uni- 
versity, plus Syracuse University, Hamil- 
ton College, Colgate University, and 
several smaller schools and special li- 
braries. 

6. Preparation of lists of cunendy re- 
ceived tides for each campus, or the en- 
tire system, of books — arranged by au- 
thor or subject, and of journals — ar- 
ranged by title or subject, or any desired 
combination. The information dissemi- 
nation aspect of this phase is of great 
im portance to all faculty, research staff, 
and student users. 

7. Education and training of libr^ 
personnel and orientation and training 
for users. 

8 Current awareness services — Selec- 
tive Dissemination of Information 
(SDI). Individual faculty mernbers or 
research groups could be notified of 
new articles and books in tiieir special- 
ized fields of interest as each new 
MEDLARS tape is received and as cata- 
log info rmation is added to the master 
files. 

9. Key Word in Context (KWIC) in- 
dexing of appropriate local research 
data, and, if desired, of journals not cov- 
ered by the major indexing services. 

10. Recurring bibliographies, e.g., 
monthly for a specific research group or 
project. 

11. Research and development of 
techniques for information storage and 
retrieval (see below). 

The major elements of the data base 
will be augmented by the circulation 
records for the Upstate Medical Center 
Library and the other libraries as they 
develop automated circulation systems. 

The user will query the system hirn- 
self, not through an intermediary, in his 
own terms, which will be translated, if 
necessary, internally. Within two min- 
utes of the completion of his query 
statement he will begin receiving the re- 
sponses. 



NLM Shared Cataloging Program 
In 1966/67 the National Library of 
Medicine negotiated agreements to be- 
gin expanding the scope of the Current 
Catalog. As stated in the 1967 fiscal year 
Annual Report of NLM : 

Negotiations were completed for a 
manually shared cataloging project 
which will result in the Francis A. 
Countway Library’s acquisitions being 
included in the CURRENT CATALOG. 
In FY 1968, the Francis A. Countway 
Library will begin submitting master 
forms of their catalog citations for inclu- 
sion in the CURRENT CATALOG. 
Those which are added to the catalog 
will reflect the NLM classification and 
MESH subject headings, as well as the 
Countway Library symbol, MBCo. 

In addition, 

SUNY/NLM Shared Cataloging Proj- 
ect arrangements were completed witii 
the SUNY Upstate Medical Center, Syr- 
acuse, New York, to: 

A. Convert NLM cmrent cataloging 
tapes to IBM 360/40 and to refor- 
mat the NLM data according to the 
current tape formats to project 
MARC of the Library of Congress. 

B. Provide programs for searching of 

the resultant tapes using IBM’s GIS 
document handling module. 

C. Experiment with batch searches of 
the resultant tapes. 

D. Share input in machine cataloging 
data. 

E. Cooperate in designing a shared ca- 
taloging system. 

Beginning in April, 1968 both Count- 
way and SUNY items will appear in the 
Current Catalog, and the contract be- 
tween SUNY and NLM has been re- 
newed in order to compile and search a 
master data base consisting of NLM, 
Countway, and SUNY machine readable 
records. 

A total of 32 full-time persons are cur- 
rently engaged in the implementation of 
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the Network, in addition to the existing 
staffs of the component libraries who 
number 92 and who may be thought of 
as resource persons for the Network pro- 
gram. 

Paralleling this development of 
mechanization of traditional library 
procedures has been a significant 
change in the concept of librarianship, 
especially medical librarianship. The li- 
brary function has been defined as the 
conscious interruption of the total 
stream or flow of recorded ideas and in- 
formation, the selective drawing off of 
manageable amounts for storage, later 
retrieval and distribution to individuals 
or groups in whatever media forms or 
formats might be required and are ap- 
propriate to satisfy known or anticipated 
needs. In other words, libraries will be 
increasingly concerned with manage- 
ment of information in whatever format 
it is in or the media used to disseminate 
it. 

In response to the question “What 
will libraries look like in the future?”. 
Stone has stated the library of the future 
is not wisely conceived as a single place 
at all, but rather as a far-flung network 
composed of units of various sizes and 
shapes, each of which may perform sim- 
ilar as well as different functions, but all 
of which will be linked together elec- 
tronically or mechanically. In the future, 
it will probably be less necessary to 
have all of the pieces of a library pro- 
gram in one place so long as the pro- 
gram parts can be linked together. In 
other words the concept has developed 
that the hbrary should be a place from 
user, rather than a place where the user 
which information is disseminated to the 
must come to acquire the information. 

The trend seems to be developing, 
particularly in newer medical schools, 
toward the centralization of administra- 
tion of all agencies concerned with the 
management and communication of in- 



formation. Among those places where 
computers, medical illustration activi- 
ties, educational media development 
and library science operations are con- 
solidated under one administrative head 
are the University of New Mexico 
School of Medicine, the University of 
Texas Medical Schools in Dallas and 
San Antonio, the California College of 
Medicine of the University of California, 
the University of Arizona School of 
Medicine and more recently, the Univer- 
sity of Alabama Health Center. In those 
cases where librarians are qualified to 
serve as information scientists, the li- 
brarians have been placed in charge of 
this administrative unit. In other places, 
men from science or medicine who have 
become interested in the modalities of 
information transfer are assuming this 
important role. 

The consolidated operation lends it- 
self toward the development of the tech- 
niques of information handling that are 
now on the horizon, but not sufficiently 
developed for implementation for five or 
ten years in the future. Among these are 
the methodologies of fact refrieval ear- 
lier referred to. Such techniques may 
use microfilm, microform, video tape, 
motion pictures, facsimile transmission 
and other media. If there is no central 
management, implementation and devel- 
opment of medical information systems 
will be hampered and, indeed, might be 
chaotic in terms of potential linkages. 

At the national level, the National Li- 
brary of Medicine has underway a mas- 
sive systems design for biomedical com- 
munications which involves several ma- 
jor information components. They are 
(1) an automated document handling li- 
brary network, (2) the development of 
a network involving the National Medi- 
cal Audiovisual Center and its concern 
with other learning resources, (3) sys- 
tems management through monitoring, 
control feedback and application of con- 



trol system procedures, (4) evaluation 
of systems operations so as to extract 
systems parameters, (5) systems inade- 
quacies and component coupling, and 
(6) the support of education through 
automated iiSormation and communica- 
tion networks, including the possible use 
of satellites for public as well as for 
medical education. All of these efforts 
are related to establishing compatibility 
among the three national libraries, as 
well as with specialized information 
centers and other emerging national in- 
formation programs. Medicine presently 
is in the forefront of these efforts and in- 
tends to share fully its experience with 
other disciplines of science and technol- 
ogy. The methods developed by NLM 
for decentralizing its computer-based in- 
formation programs and, particularly, its 
extension into all levels of support for 
medical research, education and prac- 
tice has led the President to include it as 
a prototype for the developing “knowl- 
edge network.” In this context, medical 
schools, professional societies and other 
health related organizations must partic- 
ipate by providing evaluated substantive 
input of high quality and pertinence to 
the major health problems of the nation. 

It was clearly demonstrated at the 
panel meeting that medical libraries 
have been in the forefront in the investi- 
gation and installation of modem ma- 
chine methods to cope with the rising 
flood of materials being published. Li- 
brarians have felt the need to prepare 
themselves to more fully utilize comput- 
ers in documentation and control of do- 
cumentation. It was suggested that the 
librarian take advantage of computer 
training on his own campus, because 
from the expressions at tlris meeting it 
became clear that computer center per- 
sonnel are excellent sources of informa- 



tion and support. In addition, attend- 
ance at computer courses, workshops 
and other outside advanced training 
programs should be encouraged when- 
ever possible. Libraries should seek to 
employ systems and programming .per- 
sonnel as early as possible in any com- 
puter planning development. Sharing of 
information, ideas and programs has 
given impetus to the development of 
several important cooperative ventures. 

Althou^ some librarians apparently 
still believe that students, facult)' and 
other library users might resist the use 
of computer terminals in their search to 
locate information, it was pointed out 
that these students are now being early 
introduced into instrumentation and 
computer technology in their medical 
school careers. Therefore, the library 
should be considered as another re- 
source to acquaint the student with dif- 
ferent types of equipment with which 
he may be interacting in his future 
work. 

The final recommendation of the pan- 
el was that continued federal — private 
interest and support for improved medi- 
cal library service should be sustained 
and, wherever possible, expanded. How- 
ever, careful review of on-going systems 
development in libraries should be made 
to avoid duplication of effort and thus 
avoid unnecessary expenditures. 

The panel was impressed that cost 
sharing and program sharing is now tak- 
ing place at all levels in the tradition of 
library cooperation which has developed 
over the past century. Althou^ soft- 
ware and hardware are becoming easier 
to acquire, more attention should be giv- 
en to the development of the “liveware”, 
the people, needed for the effective use 
of these systems. 
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A PROGRESS REPORT OF COMPUTER ASSISTED 
INSTRUCTION AT THE UNIVERSITY OF 
OKLAHOMA MEDICAL CENTER* 



Panel: William G. Harless, M. S., Chairman, Thomas N. Lynn, M.D., Robert C. Duncan, Ph.D., 
Eugene D. Jacobson, M.D., James A. Cutter, M.D., Arthur W. Nunnery, M.D. 



In the fall of 1966 the University of 
Oklahoma Medical Center Computing 
Facility initiated implementation of 
computer assisted instruction (CAI) as 
an educational capability for the faculty. 
The first year was used primarily for the 
indoctrination of a staff and tlie explora- 
tion of the pedagogical possibilities of 
the CAI technique. These activities have 
been previously reported. 

The first step in a new installation 
must be to define computer aided in- 
struction from a philosophical point of 
view. When this is done two very prag- 
matic problems become apparent, 
WHERE and HOW it fits into the aca- 
demic goals and activities of the Univer- 
sity. These questions must be answered 
before any significant implementation 
takes place. This answer requires a tax- 
onomy of medical education. For con- 
venience we have divided it into four 
major areas: 

1. Graduate education in the medical 
sciences 

2. In-service training in health related 
fields 

3. Undergraduate medical education 
and house staff training 

4. Continuing medical education 

Our plans include activity in all of 
these areas. The following discussion 
will concern the various activities of 
CAI in several disciplines and reflects 
the interest in the four areas mentioned 
above. Only information concerning 



material presently developed and opera- 
tional is discussed. 

The use of CAI in graduate education 
in the medical sciences had its begin- 
ning in a course called “Medical Back- 
grounds.” The course was developed 
three years ago to accommodate the in- 
creasing enrollment in the graduate divi- 
sion or the Department of Preventive 
Medicine and Public Health. Students 
entering the disciplines of environmen- 
tal health, health administration and 
biostatistics needed additional back- 
ground in order to converse with physi- 
cians and other persons in the health 
professions. The course, “Medical Back- 
grounds,” was therefore designed prima- 
rily to facilitate communications be- 
tween these students and others in the 
health profession. The course evolved 
into a two-hour didactic course lasting 
one semester. 

The IBM 1401 Data Processing Sys- 
tem was restructured to permit imple- 
mentation of computer assisted instruc- 
tion utilizing four 1050 typewriter termi- 
nals. It was decided that “Medical Back- 
grounds” was appropriate to augment 
the instruction by means of this educa- 
tional technique. Ten lessons were de- 
veloped 'Utilizing the drill approach to 
reinforce the material covered by tradi- 
tional lecture. Participation in the com- 
puter assisted instruction portion of the 
course was voluntary, and the student 
reactions were mixed. Some students 



•Presented and demonstrated by faculty members involved in computer assisted instruction. 
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found it fascinating; others resented it. 
Many mechanical failures such as the 
paper getting jammed in the typewriter 
terminal and programming systems fail- 
ures were constant sources of frustration 
to the students. 

The following year the IBM 1500 In- 
structional System was available for the 
reinforcement drill sessions. This elimi- 
nated many of the machine problems of 
the first year and proved to be a much 
more effective presentation. The greater 
flexibility in presentation afforded by 
the cathode-ray tube displays made the 
whole effort a much more palatable one 
for the students. 

There was an effort at evaluation of 
the results during the second year. The 
following observations were made con- 
cerning grade distributions and their re- 
lationship to the number of CAI lessons 



taken: 


Number of 


Average CAI 


Grade 


Students 


Lessons Taken 


A 


10 


8.8 


B 


24 


6.45 


C 


10 


5.5 


D 


1 


2.0 



Perhaps the most plausible explana- 
tion for this supportive data is that the 
A students were the more highly moti- 
vated students who can be expected to 
avail themselves of any educational 
materials available. 

The following is a list of the drill ses- 
sions available to the students in Medi- 
cal Backgrounds: 1. Medical Terminolo- 
gy; 2. Cellular Structure; 3. Dermatolo- 
gy; 4. Muscular-Skeletal System; 5. 
Hematology; 6. Respiratory System; 7. 
Endocrine System; 8. Cardiovas 9 ular 
System; 9. Gastrointestinal Tract; 10. 
Urogenital System. 

There is a lesson presently under de- 
velopment concerned with the spinal 



cord. It is a tutorial approach to the 
teaching of the basic components and 
functions of the spinal cord, and is de- 
signed to replace a lecture as opposed to 
the previous ten which serve as supple- 
mentary drill sessions for material pre- 
sented by lecture. 

One of the more promising areas of 
computer assisted instruction seems to 
exist when a student is allowed to pro- 
ject his e.xisting knowledge of a subject 
into a simulated situation. This area is 
relatively unexplored for many reasons. 
Currently it is technically difficult to in- 
terface effectively the problem solving 
and tutorial techniques in the CAI envi- 
ronment. Another difficulty is the inabil- 
ity of the author to adequately define 
the pedagogy involved in such a tech- 
nique which results in dangerously ne- 
bulous goals for the session. One further 
important problem that inhibits the 
progress of such development is the to- 
tal Involvement required of the profes- 
sor during the development of the ses- 
sion. 

In an attempt to transcend these 
problems and provide an effective learn- 
ing tool, the Department of Biostatistics 
and Epidemiology of the School of 
Health is responsible for preparing a les- 
son in sampling theory involving a dy- 
namic model of a population. The lesson 
requires an interface behveen the Course- 
writer langxiage for a tutorial mode 
and the MAT language for a problem 
solving mode. The simulated situation is 
developed for the student in the Course- 
writer mode. He is allowed to pick what 
he considers to be the appropriate ana- 
lytical methods needed to solve the sam- 
pling problem presented. Once this is 
accomplished he is directed to switch to 
the MAT mode. Utilizing Monte Carlo 
methods in this problem solving mode, a 
sample is generated. The student’s pro- 
cedural choice in phase one is used, and 
the appropriate subroutines are called 
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by the student to analyze the generated 
data. When the analysis’ is complete, the 
student switches back to the Course- 
writer mode where structured interaction 
occurs between the student and the 
computer concerning the appropriate- 
ness of the student’s analysis and 
other aspects of the problem. This is 
the critique phase of the student’s prob- 
lem solving experienee and the tutorial 
mode will again be in effeet. If the stu- 
dent choose the appropriate methods, he 
will be reinforced, If his chosen metho- 
dology was inappropriate, he will be 
told so and a proper method suggested. 
The problem may then be extended or a 
new problem introduced and a branch is 
executed back to phase one for another 
choice of methodology by the student. 
Tlie plans are for various data to be cop- 
ied by the student and brought back for 
class discussion. This allows for many 
different sampling situations to be pre- 
.sented and facilitates class discussion. 

It is important that the students ap- 
preciate the dynamic nature of the situa- 
tion. They must not feel that the situa- 
tion is so structured that there i.s a single 
solution to any problem presented. This 
.system gives him the feeling of problem 
.solving in real time: a live situation 
rather than guessing with the machine 
or the professor concerning the answer 
to a structured problem. 

These techniques may be utilized in 
other areas of medicine such as diagnos- 
tic procedures, patient management, 
computation of water and electrolyte 
balances, drug therapy and the compli- 
cations of misuse of drugs, and possibly 
in epidemiology concerning the investi- 
gation of contagious disease models. 

It is very difficult indeed to measure 
the efficiency of such an educational ap- 
proach and, as has been stated earlier, 
the total involvement required of a pro- 
fessor is an inhibiting factor to this ap- 
proach. But the knowledge that one is 



teaching things that are difficult to 
teach under the current system is per- 
haps justification enough for the effort. 
More work needs to be done concerning 
technique development before appropri- 
ate evaluations and traditional efficiency 
mca.surcs can be made. 

The Department of Pediatrics has 
elected to use the tutorial approach in 
programming lessons concerning the 
principles of feeding in infant nutrition 
for junior and senior medical students. 
Under the cuirent curriculum the ftird 
year students rotate in groups of 12 or 
13 for five weeks on the pediatrics serv- 
ice. It is during this period of time that 
they are expo.sed to the computer assist- 
ed instruction material covering infant 
nutrition. The fourth year medical stu- 
dents rotate in groups of two for one 
week in the newborn service. These stu- 
dents are responsible for talking with 
the mothers of the newborn with refer- 
ence to the feeding requirem.ents, selec- 
tion of the formula, and explaining the 
appropriate preparation procedures. 
The computer assisted instruction le.s- 
sons on formula feeding and infant nu- 
trition are used as orientation sessions 
for these students. The decision has 
been made to pursue infant nutrition in 
greater depth utilizing CAI techniques. 
Information concerning molecular nutri- 
tion taught by the Department of Bio- 
chemistry will soon be available utiliz- 
ing the computer assisted instruction fa- 
cility. Ultimately, it is envisioned that 
by the time a freshman medical class 
reaches the third year, all of the infor- 
mation concerning these matters related 
to infant nutrition in the basic sciences 
will be available to the students for 
reference or as refresher courses. Hope- 
fully this will help to bridge a gap be- 
tween the basic science education and 
the clinical experience. 

Generally, at this point, the accept- 
ance by the students involved is favora- 
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ble. Previously a two-hour-a-week tuto- 
rial session was required in infant nutri- 
tion by the Pediatrics instructors with 
the fourth year students. This has been 
cut to about ten minutes a week. 

One of several unique features added 
to the course in medical physiology for 
the academic year 1968 is the use of 
computer assisted instruction to teach 
two lessons. The lessons concern “the 
action potential” and “pancreatic secre- 
tion.” The Physiology Department has 
moved cautiously into the area, carefully 
building in evaluation procedures for 
academic effectiveness. For the material 
concerning the action potential, one half 
of the class is randomly selected to take 
the lesson on the computer; the other 
half of the class takes the lesson by tra- 
ditional lecture. Some weeks later for 
the material on pancreatic secretion the 
two halves of the class are reversed so 
that the group that had the first com- 
puter lesson now gets the lecture by tra- 
ditional means and the other group gets 
the computerized material. Each half of 
the class will be tested by the same ex- 
amination. This type of design will ob- 
viously allow the students to be their 
own controls and a comparison of the 
lecture versus the computerized material 
can be made for the entire class. 

One of the most attractive things 
about CAI to the Physiology Depart- 
ment concerns the available literature 
today which seems to indicate that the 
less endowed students receive the most 
benefit from the technique. The stu- 
dents at the top of the class do about as 
well regardless of the method of mate- 
rial presentation. It is the feeling of the 
Physiology Department that the com- 
puter could, at the very least, provide a 
supplement to the traditional education- 
al system which would be helpful to the 
students having difficulty with the tradi- 
tional system. 

In the Department of Anesthesiology 



there is a lesson developed from a paper 
authored by Dr. Joseph M. White and 
Dr. James A. Cutter concerning resusci- 
tation and anesthesia in crushed chest 
patients. This is an approach to the use 
of computer assisted instruction in the 
continuing education of physicians. The 
material is in a tutorial mode and ex- 
plores the latest techniques in emergen- 
cy cases concerning resuscitation and 
anesthesia. The method of implementing 
this lesson involved the direct program- 
ming of a paper which appeared in the 
JOURNAL OF AMERICAN SURGERY 
entitled “Resuscitation and Anesthesia 
in Crushed Chest Patients”. The lesson 
has been presented to a group of 16 gen- 
eral practitioners who attended a two- 
week course at the University of Okla- 
homa Medical Center in postgraduate 
clinical anesthesia. Incorporated in the 
course is the possibility of selecting any 
area of the subject the student wishes to 
review by simply typing “outline”. This 
causes the outline of the material cov- 
ered in the lesson to appear on the 
screen. This capability is available to the 
student at any point during the lesson. 
The lesson has also been programmed 
for the word “Comment” to be recog- 
nized by the computer anytime it is en- 
tered by the student. The screen is 
immediately cleared and the student is 
allowed to type whatever he likes. His 
message is recorded on magnetic tape 
and the program subsequently branches 
back to the point reached in the lesson 
when “Comment” was requested. This 
gives the student the ability to disagree 
with any portion of the lesson or to 
make comments to the author at any 
time. There are strong indicators at this 
point that computer assisted instruction 
will be a significant factor in the future 
of continuing education of physicians. 
Many of the traditional problems, such 
as distance of the physician from a 
learning center and lack of time for 
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extensive blocks of continuing education 
effort, are transcended by the very na- 
ture of computer assisted instruction. It 
is entirely conceivable and practical at 
this point for a terminal to be placed in 
a remote station and tied by voice grade 
telephone lines to the computing facility 
in a learning center such as the Univer- 
sity of Oklahoma Medical Center. 

Certainly one of the requirements of 
the successful development of a comput- 
er assisted instruction effort is that the 
faculty understand and want the facili- 
ty. Tnese requirements are met at the 
University of Oklahoma Medical Center. 
The faculty is not only interested but 
they are also permissive in allowing the 
other disciplines ( computer theorists and 
learning theorists ) to develop their tech- 
niques which are fundamental to an ef- 
fective system. An effective marriage 
must exist between the computer scien- 
tists, the learning theorists and the fac- 
ulty. Real success can ultimately be real- 
ized only when these individual efforts 
are inte^ated in an enviromnent of effi- 
cient and effective learning for the stu- 
dent. 

Summary 

The following is a summary of thfe 
CAI material made available to the con- 
ferees during their visit to the Universi- 
ty of Oklahoma Medical Center: 

1. THE CARDIOVASCULAR SYS- 
TEM (School of HealA)^— A drill 
session concerning basic cardiology. 
This is an excerpt from the lesson on 
the cardiovascular system presented 
to the graduate class in Medical 
Backgrounds taught by Dr. Thomas 
N. Lynn. 

2. THE HUMAN SPINAL CORD 
(School of Health) — A tutorial ap- 
proach to the teaching of the basic 
components and functions of the hu- 
man spinal cord. This is an excerpl 



from a lesson by Dr. Thomas N. Lynn 
for the Medical Backgrounds class. 

3. INFANT NUTRITION (Pediatrics) 
— Two lessons concerning feeding 
principles and infant nutrition in a 
tutorial mode were prepared by Dr. 
Arthur W. Nunnery of the Depart- 
ment of Pediatrics. One lesson dis- 
cusses breast feeding and the other, 
formula preparatidn. The material is 
used by junior and senior medical 
students. 

4. ACTION POTENTIAL (Physiolo- 
gy) — A tutorial exposition concern- 
ing the action potential in Physiology. 
This lesson is being used by freshman 
medical students. The professor is Dr. 
Roger Thies of the Department of 
Physiology. 

5. PANCREATIC SECRETION (Phy- 
siology) — A tutorial approach to the 
teaching of pancreatic secretion by 
Dr. Eugene D. Jacobson of the De- 
partment of Physiology. This lesson is 
is being usied by freshman medical 
students. 

6. SAMPLING THEORY (Biostatis- 
tics) - This lesson is an integrated 
approach utilizing tutorial and prob- 
lem solving techniques in computer 
aided instruction. The professor is 
Dr. Robert C. Duncan of the Biosta- 
tistics and Epidemiology Depart- 
ment. The lesson is to be used by 
graduate students in the Department 
of Biostatistics and Epidemiology. 

7. RESUSCITATION IN ANESTHE- 
SIA AND CRUSHED CHEST PA- 
TIENTS (Anesthesiology) — This 
lesson is designed to explore the pos- 
sibilities of the use of CAI techniques 
in research reporting. The material 
was authored by Dr. Joseph M. 
White and Dr. James A. Cutter. It is 
envisioned as an approach to the use 
of computer aided instruction in the 
continuing education of physicians. 
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CLOSING COMMENTS 



This conference has been concerned with the role of compilers in mescal 
education. Past and present experiences of knowledgeable leaders have been 
presented and discussed as well as new theories and ideas. Plans for the tutoe 
kution of problems and expansion into operational services to education have 
been expressed, and it appears that the tools are available to ineet the challenges 
presented here. Our ability and desire to do the job remain to be garnered. 

Two resolutions were presented and endorsed by those in attendance, and 
they are reproduced here. 

1. “The heart of this conference has been interaction among knowledgeable 
people. It was the first of its type in this respect and dealt with an im- 
portant topic, computer aided instruction in medical education. Be it 
resolved that a conference utilizing the interactive format and discussing 
computers in medical education be held on an annual basis. 

2. “Be it resolved that we commend the University of Oklahoma Medical 
Center and the United States Public Health Service for their conduct and 
support of this conference and in particular that we commend Dr. James 
L. Dennis, Dr. Joseph M. White, Dr. Edward N. Brandt. Jr., Mr. Wilham 
Harless and Miss EUzabeth Ray of the University of Oklahoma Medical 
Center, and Dr. Frank McKee, Mr. Norman Tucker and Mr. Norman 
Rydland of the United States Public Health Service and the most et- 
ficient supporting staff." 

The conference was adjourned at noon on Friday, April 5, 1968. 
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